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FOREWORD , 


od 


The objective of this report is to provide a cofhprehensive review. 
of that literature on the admissions process to U.S. medical schools 
_ % which has ‘been produced since 1955. Where information permits, the . Oe ee 
review includes a description of the relationship between ‘the admissions 
Process and the meeting of national and institutional goals (e.g. ; 
i, increased opportunities for minorities, women, and students from finan- 
cially-disadvantaged backgrounds). on A 


Several trends relating to medical education and to the provision 
of medical care which became obvious imtrecent years. have combined to 
focus interest on medical schools admissions. ‘One of the major trends 
has been the phenomenal increase in applicatioris for admission. Con- 

. current with the increased student interest in a medical career, there 
has developed a recognition of the need for ‘increased representation in 
the physician.pooi of minorities, women, andr persons from economically 
disadvantaged backgrounds. In addition, an \ertier concern with pre- 
venting a threatened’ geneva] shortage of phys*cians has been replaced by 
concerns over the distribution of specialties—and practice locations. 


In order to fully understand these issues and their relationship to 
the admissions process, one must examine them in the eontext of the entire 
admissions system. Im addition, an historical perspective is: helpful in 
understanding how @hese trerds have evolved. The intention of this review, 
hale to be as comprehensive as possible in examining all impor- 

‘tant aspects of the sadnissions process. The six major areas covered are: 
a) historical trends“ the admissions process; b) the logistics of the 
application process; c)-the composition and functions of admissdons com- 
mittees; d) thé range of criteria for the selection of students; e) the 
weighting of selection criteria used in various médical schoolsy and 
f) changes in the characteristics of accepted and rejected applicants. 


; Besides providing a survey and synthesis of the efforts and research 
_’. undertaken to improve the admissions process, thitreview was originally 
intended to have served as the groundwork for a quantitative analysis of ° . 
the trends in, an@ the goals of, the admissions process, from both a 
national and .an fnstitutional Perspective. However, an exhaustive search ; . 
of the Titerature uncovered almost no systematic data, on either the . \ 
national-or the institutional level, on goals and very little institu- 
--«=¢fonat“data ontrends. This search involved scanning the catalogues of 
selected medical schools for the past twenty years in an effort to deter- 
"mine whether’ they contained any statements concerning their institutional 
-goals. It was found that the only statements on this topic were of too ° 
" c.--vague and general a nature to be of use in the Proposed quantitative 
_ analysis. In addition, a similar search was made of ‘the Medical School. 


Cg. Adinissfons Re uirements handbooks for 1955 through 1976.’ This search also 


wie 
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failed, to turn up adequate information for this type of analysis: . Like~ 
wise, all other sources of information used in thjs literature revjew-~ 

the Journal of Medical Education, published and unpublished reports, 
etc.--were Careful ly examined. ‘ Again, no data were found which would per- : 
mit a’quantified analysis of the trends in goal modification. for ‘the 


‘admissions process from either a. national or institutiohal basis. 


It was felt, therefore, that rather than abandon entirely the analysis " 


of institutional and national] goals and trends, a singJe more insightful 
document would result by combining the literature review with a.qualita- 
tive analysis of these: variables in those areas where information would 


‘permit. Accordingly, the first chapter, an historical overview of the 


admissions’ process, was included to provide a national perspective on gen- 


_ gral trends against which institutional efforts could be compared. Implicit 


in these actual ‘efforts are the unstated goals of the medical institutions. 
. . & 


The sources used in this literature review were located in several 
ways. Various published bibliographies (e.g., Nourse and Johnson, 1966; 
Schofield, 1972; Smith, 1972; -D'Costa and Yancik, 1974; Mathews, 1975; 
and Floyd, 1976) provided an introduction to the literature. After con- 
sidering several rag lathe computer systems, two proved fruitful: 
the Medical Literature Analysis and Retrieval System (MEDLARS); and the 


Educational Rggources Information Center (ERIC). 


Literature reviews, on related subject matter provided numerous "leads" 
(e.g., McGuire’, 1972; Applied Management Sciences, 1976; and Yett, 1976); 
and references were gleaned from the bibliographies of each individual 
source which we read. Po . 


» An issue-by-issue search was made of volumes 30 through 51 of the 
Journal of Medical Education (which cover the years from 1955 to the pres- 


ent), and the AAMC’s handbooks on Médical School Admissions Ree 
and on Minority Student Opportunities in United States Medical Schools, 


“were carefully examined for relevant material. Catalogues for Individ- 


ual medical schools were not utilized since a trial run revealed that the 
relevant admissions information in¢luded in them almost always appeared 
‘in the Medical School Admissions Requirements handbooks. 


Certain individuals identified as involved in related research at 
the AAMC and elsewhere were contacted and some of -their recommendations 
proved helpful fn locating additional sources. of: information. 


A compilation of all the references garnered from the above sources 
is. presented in an’ alphabetical bibliography at the end of this report. 
Extensive overlaps in the subject medtendf the references mitigated 
against any attempt to arrange them by Subject headings. While the 
diverse nature, of the sources made it extremely difficult to use any 
one standardized bibliographic form, we generally relied upon the 
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Publication Manual of the American Psychological Association, Second 


Edition for guidance in presenting the references. 
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This report was. prepared by Janet Melei Cuca, Research Associate; Linda 
A. Sakakeeny, ‘Research Assistant; and Davis G. Johnson, Ph.D., Director, 
AAMC Division. of Student Studies... , : 
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‘NATIONAL TRENDS IN MEDICAL SCHOOL ADMISSIONS 


The. purpose of this chapter is to provide a broad historical perspec- 
tive against which changes inthe admissions: process during the past 


twenty years can be viewed and understood. Particular .emphasis is placed 


a ‘ a a 
© 4 CHAPTER I | 2 
HISTORICAL OVERVIEW ‘OF $3 ae 


on the relationships that were apparent between the medical school admis-_ 
sions process ‘and the meeting of institutional and national objectives. 


Since several ‘important precursors of these relationships ‘appeared during 


and immediately after World War. Il, a brief Summary is also.provided of 


ae period. 


- 


we 


' 
a t - \ 
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World War Il»and the Early 1950's 


> To fulfill military manpower needs during the War, the selection of 
medical students was made primarily by Army and Navy officials in consul- 
tation with ‘medical school admissions officers. Since the premedical . 
program waS also largely under the auspices of the military, Yt was possi- 
ble to evaluate students within each region and to assign them to a medi- 
_cal school within that region. During the War, 80 percent of the 
‘available places were filled by this admissions technique. The remaining 
‘20 percent of the students. were selected solely by the medical schools ; 


“Aram draft-exempt men and From, women (Codper, 1976b). 


q 


Another major change in the admissjons process came one 
- following the War. Thanks to the G.I. Bill and to the large number of 
potential medical students who had been in the military service several 


years, a four to one ratio of ‘applicants to places - 
occurred in the late 1940's in contrast to the two 
_ existed prior to’the War (Johnson and Hutchins, 1966)> 


n medical school 
One ratio that had 


Since the federal government financed much of premedical and medical 
‘education during and immediately after World War II, the objectives of 
' increased equal educational opportunity were able to be met to a greater 
degree than before. 


1 ws 


Another Reet prior to 1955 was the early effort to 
interpret the medical school admissions process'to .applicants and to the 
public at large. The year 1950 saw publication of the first edition of 
the AAMC's Medical School Admissions Requirements book (AAMC, 1976c). 
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A preliminary version, however, entitled Handb for Advisors to Students 
- Planning’ to Enter Medicine, was published by fhe AAMC in 947. ; 
\ - 
U . 


1955 Through 1959 


_ The second half of the 1950's saw several major efforts to analyze and ~ 
improve the medical school admissions process. Of particuJar significance |. ° 
was the Fourth Teaching Institute held by the AAMC in 1956, which was de- 
voted entirely to the topic of medical school.admissions (Gee and Cowjes , 
1957). Participants in the Institute included not only admissions officers . 
and/or other appropriate representatives from each U.S. medical school, but -/ 

, 8lso national experts in testing, evaluation and selections In prepara-  - 
tion for the Institute, extensive questionnaires were sent to each medical - 
School relative to their admissions process.: Related questionnaires were 
also completed by almost al] medical students admitted to the 1956 enter- 
ing class in order to obtain their critique of the admissiqns process 
(AAMC, 1956). . . 

This Institute not only served to educate admissions officers concern+ 
ing the state of the art’ in student selection but it also resulted ina ~ J 
detailed report of the proceedings and reference materials, which served ~~ 
as a guide to newly appointed admissions officers for years to come (Gee ij 
and Cowles, 1957). : eh / 

. 7 ok / 

An important outcome of the Institute was ihevoraanizacion the foltow- 
ing year of the AAMC Continuing Group on Student Evaluation (now called. 
the Group on Student Affairs or: the GSA). As described by Johnson and 
Tuttle (1973), this organization brought medical School admissions - 

- officers together in annual regional and national meetings and in com- : 
mittees thus allowing them to continué their joint efforts to, gfalyze and x 
improve the admissions process. Their yearly regional and national meet- 
ings typically included detailed discussions of both the medical student 
selection soces and of new research on that topic (AAMC, 19584). 


Due tp a relative shortage in the number of applicants during the 
1950's, Foaior focus of the 1956 Teaching Institute, of the GSA meetings 
and of publications such as Medical’ School Admissions Requirements was on 
the need to recruit more and better candidates. It was during this period 
that the admissions officers of some schools with strong state residency 
requirements literally felt that they were "scraping the bottom of the 
barrel." to fill the last few places in their entering classes. Indeed, 
the declining talent poot for medical school admission was generally 
2 viewed asa national problem (AAMC, 1962). | - 2 
Another probable reason for the lack of candidates to U.S. medica] 
schools (above and beyond the shortage of 22 years olds) was the 1957 


rs — 
r«) ae ( : . - # " 
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 Jaunching of SPUTNIK by the Russians.” The consequent increased 
’ of ‘careers in engineering and the physical sciences aggravated the problem 
/ of a shortage of qualified medical school applicants. In spite of. this 


a! 


popularity 


a 


J shortage, the need for physicians was so great that. the late 1950's saw 
several national reports calling for more medical schools, increased en- — 
rollments and more graduates in order to meet projected health manpower. 
needs of the future (AAMC,. 1958; Surgeon General's Consultant ‘Group, 1959). ® 
5 o 2 . bd ; 
we 


f. ’ - >, 1960 Through 1964 


— 


\ . ° . ; * Fy 
, .- To help meet institutional, state and national objectives of-a’ larger 
applicant pool’ from which to pick higher quality candidates, the early 
1960's saw several major efforts to increase the financial incentives for 
applying, entering and remaining in medical. school. Lae 
‘ io 
The earlier efforts along these lines came from the private sector. 
For example, in 1961 the Avalon Foundation of New York City gave grants 
for student scholarships to each’ of the 86 U.S. medical schools, totaling 
approximately $1,100,000. In the words of the Foundation news release, - . 
"The grants are designed to attract more students and more competént 
‘students to the study of medicine and to help meet the present need for. | 
more physicians in the United States." The significance of these grants 
: * becomes apparent when one considers that the total scholarship expendi- .. 
: tures by all U.S. medical schools in 1959-60 was only $2,252,000. . : 


The first major financial incentive from the federal goverament to’. 
attract and retain medical students came in the form of the Heaith Pro-". 
7 fessions Educational Assistance Act of 1963, which included a provision.: , 
r for student loans. Also during the 1960's, some of the state governments 
: started supporting private schools in return for the schools giving ad-~ 
_ missions preference to residents of the state (Cooper, 1976b). : 


In addition to the shortage of qualified applicants, the growing 
attrition rate of medical students during the early 1960's stimulated 
further efforts to analyze and improve the admissions process (Penrod, 
1964). A national study of medical student attrition, under the auspices 
of ‘the AAMC Group on Student Affairs, was begun in 1962 and reported in 

\ final form in 1966 (Johnson and Hutchins). Since most of the study activ- - 
. ity was carried out prior to.1966, it is discussed here rather than in 
the next section of this chapter. 


The study included site visits to 20 medical schools, analysis of 
over 4,000 detailed questionnaires and numerous discussions of attrition 
at regional and national meetings of admissions officers. Perhaps even - 
more than the final report itself, this "process" of ‘studying the attri- 
tion problem served to sensitize admissions officers and deans to: what 
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could be done to improve admissions and retention’ Pertinent suggestions 


’ from that study in the area of admjssvons are summarized below: 


; Enlarging thie Applicant Pool 


Ls Encourage ‘the reduction: se, desavanhical restrictions 
on the basis that it is better #© graduate nonresidents _ 
who may practice im your area than to fail residents who 
can't practice medicine anywhere. | ae 
2. Recruit at both high school and college levels, ge ows 
‘ using such et as Career days, future, physician ps : 
clubs, explorer scouts, and ‘sammer research programs, ,° 
At some schools medical students and even accepted -° ” 
applicants function,as recruiters. a 
3. Incredse sources of available- financial aid: for _ 
‘students. One school recently added 30 admissions 
scholarships for } entering class. ° : 


ge 


Improving. the Selection of Students ." 


1. ‘Appoint qualified, knowledgeable admiss tans com: ws * 
mittees which are comprised of‘senior faculty, PSy- 
chiatrists, and psychologists. Some schools finance 
regular luncheon or dinner. meetings for these commit-— 
tees. 

an Provide for more intensive screening of applicants 
who are of questionable ‘maturity, motivation, or stabil- 
ity. Some schogls-also interview spouses of applicants. 

3. Increase efforts to acquaint applicants with ‘the 
nature and demands of modern medica] education. Some 
schools devote a full day to orienting and interviewing . 
applicants, Making extensive use of’ upper- -class medical cy 
students in this process. 


(Johnson and Hutchins, 1966, ABE) 


Other efforts to improve the admissions process during the first half 
of the 1960's included the initiation of The Advisor, a newsletter for 
premedical advisors, and the production of the first edition of the 
Medical College Admission Test Handbook for Admissions Committees (AAMC, - 
1964). The latter publication and its successor (Sedlacek, 1967), al- 
though both are now out of print, are landmark references concerning the 
reliability, validity, and predictiye powers of the MCAT. |» 


The early 1960's also saw the formation of a national MCAT advisory . 
committee. .. This committee, composed of admissions officers;from various 
regfons of thie country, served to advjse the AAMC on the mgnitoring and 
use of this examination’ Because of the shortage of applicants aad — 
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rising attrition, a major initial focus of. the soneitttae was on better use 
of the MCAT to identify candidates who could successfully: obtain the M.D. 
degree and:-go out into the practice of medicine. ' 


Finally, this five year ‘period was marked by the ubiextton of a sub-_ 
_ Stantial number of articles concerning more efficient and reliable methods 
‘of selecting medical students. ‘These articles are discussed in greater 
detail in later sections of a literature review, particularly in Chap- 
ters IV and:V. 


1965 Through 1969 


Compared with the previous ten years, the period from 1965 through 1969 
saw’a ferment of activity directed at meeting institutional and national 
objectives. These activities included a number of changes jn the 
Scns TONS process. ‘ 

It was during this period. of time, for ‘ecanie, “that a Series of Josiah 
‘Macy, Foundation workshops and meetings helped sensitize medical school ad-- | 
‘ ministrators and admissions officers to the need ‘for equal opportunity in | 

. medicine for women (Lopate,'1968)sand for minority group students (Johnson, 
- 1968b). Some of these meetings were co-sponsored by the AAMC and others | 
were under. the sole auspices of that association (Johnson, . 1969). 


This period of the Vietnam War, the assassination of Dr. Martin Luther 
King, Jr., the Civil Rights-movement and the women's movement also cul- 
minated in a considerable amount of medical student activism. (Johnson, 
1968a). All these factors encouraged?admissions officers to add cara 
women, and members of minority groups to their recruiting and retention, 
efforts (Jarecky, 1969). : 

‘Increased financing from the federal government in “the form of student 
schalarships, capitation grants, etc. helped yield) a. the meeting of « 

' these national poacer ties: (See particularly page 2/7. of ida 


. The late 1960's also sdw subStantial funding from ae Office of .' 
Economic Opportunity (0E0) via the AAMC ‘which helped finance. activities 
directed at the recruitment, admission and retention of minority group 
medical students (AAMC, 1971b). Related efforts-of the AAMC included 

a) the establishment in 1969 of a Medical Minority Applicant Registry 
(Med~MAR) and b) the publication that same year of the first edition of. 
Minority Student 0 ortuni ties in U.S. Medical Schools (tse sey 


Div. o udent rograms , 
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The Student American: Medical Association and the Student Health 
Organization were, increasingly active during the 1960's and helpedcpressure 
the medical sichoots to modify their admission practices Cohnsor Tope 
Grahain and Royer, 1973). Likewise, the admissions officers .themselves were 
encouraging change through such forces as the "AAMC Group on Student 
- Affairs' Committee on the Medical Education of Minority Group Students , 


which was established “in 1968 (Jokinson and Tuttle sgl973).. 


Another major breakthrough, as far as applicants and their premedical-: 
advisors were concerned, was the long-awaited decision to release MCAT . 
. scores directly to the students , starting with the May, 1968-test. 
‘(AAMC ,' 1969b’, p. 422). In the past, these scores had been treated as con-~ 
fidential in the belief that applicants and their advisors might put ° 
undue ‘pressure, on the medical schools to admit those students with high 
test scores. but with inadequate personal qualifications... ‘This action re- 
sulted in part from. encouragement by those: preprofessionat ‘advisors who 
started organizing in ne late ae Ss as regional groups (Grant and. 
Bennett, 1968)... - : 


Motivated in part by the accending: curve of app) icants per number of 


‘avi lable places, the American’ Medical College Application Service (AMCAS): 


was developed in the late.1960"s and pilot studies were conducted in 1968 - 
and 1969 (AAMC, 1970¢). _As detailed in Chapter II, AMCAS allows applicants 
to submit a single’ application and a single set of transcripts which are 


processed by the AAMC and forwarded to participating medical schools. It _ 


also provides an excellent research base for analysis. of trends-in student.. 
characteristics which can document changes-in the admissions process, 
especially those changes related to meeting institutional and national 

op Jecwives: for diversified physician manpower. ‘ 


. "The 1970's —_ _ 


Because the 1970! S have seen an even more rapid acceleration in the 
numbers of applicants than was true in earlier periods, there has been an 
intensification of. the efforts of the late 1960's to°analyze and. improve 
the admissions process. .Both the intense pressures on admissions commit-: 
tees and a number of Suggested solutions to these pressures have been 
summarized by Green and Johnson (1972). 


Strong encouragement to solve basic health manpower problems also 
came from the’ federal government during the early 1970's. For example, 
Elliot Richardson (who was then Secretary of the Department of Health, 
Education and Welfare) stressed, at the 1971 AAMC Annual Meeting; the 
urgone nee to overcome national problems of geographical and specialty 
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distribution (Richardson, 1972). Similarly, with the passage of Rublic 
Law 92-157,:the U.S. Congress encouraged the jncreased enrollment, of 
individuals most likely to meet such needs (U.S. Congress, 197T). _ 

ee 4 . 5 a . 

The 1970's have algé been characterized’ by-a growing "institutionalt-. 
zation" of efforts to improve the admissions process. For example, the - 
AAMC:Committee on the Expansion of Medical Education, in its September / ° 
1970,report, made a number of specific recommendations concerning the. . : 
Supply of qualified applicants and what should be done to find places for 


7 at 


-them. Objectives of the proposed program included not only increasing the 


phys icidn-population ratio but also achieving better geographic distribu- 
tion, less,dependence upon foreign medical graduates and a more rational 
distribution of physicians in the various specialties (AAMC, 1971a). 
8 : . ae . : + 
‘In April of 1970 the AAMC Task Force tothe Inter-Associatfon. Committee 
On Expanding Educational Opportunities, in Medicine for Btacks and Other 
Minority Students submitted a report which included a recommended short- 
~ range target of 12 percent minority admissions by 1975-76 (AAMC, 1970a; 
Nelson, Bird & Rogers, Htiee a This report was later endorsed by the C. 
Executive Council as well as iby the American a eerie ihe 
- report was reinforced by articles such as that o "Curbing the Black — 
Physician Manpower Shortage! {Thompson 1974). 


> 


.-_- Because. of the increasingly large numbers of U.S.-citizens gging abroad 
» for their,medical education, the AAMC also initiated in 1970:a Coordinated 
*. Transfer Application System (COTRANS) which has assisted a number\of those 
. Studying abroad*to return ard to gain advance standing in U.S. medjcal 
schools (Dubé, 1975), " boat 8 


Another institutionalized development was thé formatiop in 1971 of~the 
AAMC Organization of Student Representatives (AAMC,-1972a). ‘OSR’has. pro- 
_Vided medical students direct input to the AAMC rather than -having to 
“grab the microphones" as they did during the student..activist days of 
_the 1960's.(Johnson, 1968a). Among the significant contributions .of OSR 
“to the admissions: process have beer’ several formal resolutions calling 
for the AAMC to gather and disSeminate to prospective applicants and to 
Premedical advisors more data on medical school admissions. OSR-sponsored 
resolutions approved by the AAMC assembly in1973 called on the AAMC ° 
for: a) the inclusion of more extensive information in Medical School. 
Admission Requirements about student characteristics (including sex and. 
‘minortty group. composit%on)- at each school and b) assistance to‘under- 
graduate colleges in providing information to their premedical students 
regarding the results of applicatigns to medical schools from their 


preceding classes of premedical students (AAMC, 1974b). «Both of these — 
resotuttons have been carried out by AAMC staff. 


- Another significant effort to’ improve the admissions process during 
this decade’'was a $10,000,000 grant in 1972 from the Robert Wood Johnson 
Foundation for use by medical schools from 1972 to 1976 -in recruiting and 
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' nation. This grant ‘was administered: by, the AAMC ( 


‘, in Chapter IV. 


retaining, students who are feels: from underfepresented minority groups, 
and/or from rural areas: . It was assumed that these individuals would be 
more apt to meet: the geographical and specialty See needs of the 

194 3c). ' 


' Several projects were also eared out in the early 1970'sythat re- 
“lated to the makeup and functfoning of medical school admission committees. 
(Oetgen and Pepper,.-1972; Graham and Royer, 1973). A major thrust of, these 
projects was to encourage greater-representatidn on admissiqn committees of 
Students, minority group members. and community representatives. Although 


"not completely documented, it is probably true that jin the} 1950's and ear] 


1960's, most medical school admission committee members—wére full-time 
Faculty who placed a.significant emphasis on’ research (Gee .and Cowles, 
1957). Accordingly, they may ‘fave been more. inclined to pick students with 
similar leanings. Admissions committees of the 1970's incTude more | 


sHucents and minority group wes coe and Pepper,- Ties Lambson, 
1975b). wee . 
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Due. in part to the intreastiig Hiabars of applicants, a medical’ school 
admissions matching plan was finally given a trial in 1973 after many 


years of discussion (Cooper and Davenport, 1983). Although a matching plan. 


was proven to-be technically feasjbJe, it was decided that its*disadvan- 
tages ‘outweighed , its advaritages.* Tare: ly a not implemented, on 
a national ldvel (Report of ‘the AAMC 7). 


cy 


Also due in part to the improved qualifications of applicants ; the 


- Medical College Admissipn Test became somewhat less predictive of success 


‘in medical’ school during the 1970's. For this and other reasons, a major 
effort has been undertaken to revise the MCAT and to develop a new Medical 
College Admissions Assessment Program (MCAAP). >Although early emphasis | 
will be on measures of cognitive skills (including problem solving), it ‘ 
is intended eventually to develop measures ‘of non-cognitive qualities 

(AAMC , 1973b). This program is discissed more fully in Chapter IV. 


Special efforts are also-betng made to devise admissions techniques 
{that will help detect qualified ‘students fram disadvantaged backgrounds 
- whose credentials may not confornt to traditional standards.of. evaluation. 
-A major endeavor: along these lines has been the AAMC development of the 

Simulated Minority Admissions Exercise (D'Costa et al., 1974) which has 


‘ now been carried out at a significant number- of medical schools and at 


regional meetings of minority affairs officers, admissions officers and 

medical School deans. ‘These-workshops help to sensitize those involved 
in the admissions process. td the complex ‘issues involved in selecting 
"nontraditional" SPI NGA Se This program also, is more fully discussed 
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In connection with minority admissions, the 1970's have also seen 4 
Significant number of actual or ‘threatened lawsuits against medical 
schools and-their. admissions committees. These suits have usually 
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claimed that the applicant in question had been rejected while ostensibly 
less well’ qualified candidates were accepted. The AAMC Has conducted 
» several surveys, related to admissions lawsuits (AAMC,:1972b and 1975d), and 
-filed Amicus Curiae Briefs in relation: to both the DeFunis case (AAMC, 
1974a) and the Bakke-Davis case (AAMC, 1976a). It has also recently | 
established'a Task Force on Minority Opportunities in Seeley a to he lpigz 
,ye Aetermine why there has been a dropoff in minority applicant¢ (AAMC, a'3% 
ei: Aopefully, the findings of this Task Force may help a ge and 
: 4s national objectives to-‘Mevease the reprgsentation of qualified minority 
sro members in the study and practice of medicine. . "s 


i ‘ . cr : 
Because of concern that rising tuitions and decreasing financial aid 
_ May result ‘in future medical scheo}~applicants coming mainly from upper 
. ¥ncome backgrounds, the AAMC has ‘also recently established a Task Force on. .~ 
~' Student Financing. ‘Both of these Task Forces, appointed in early 1976, . ™ 


are to present final reborts to the AAMC Executive Council by the Spring 


© 


of 1978 and interim reports along the way (AAMC, 1976d). 
ele te greg OTE et a aM Tee ‘ 
Fimatly,: a growing awarthess on the part of medical school officials 

» Of the need for selecting students who are most likely to enter Hae 
. cdre shécialtdes*and~fo serve geographical areas. of national need (AAMS, 
’ 1975b) -i1 1ust¥des‘ the increased emphasis, on helping meet societal needs 

through the admissions process (Colwill, 1973, 1976). Thus, whereas 20 

years ago most admissions officers were primarily concerned with choosing. 

the academically best qualified applicants, today's admissions officers 

‘are trying to recruit and select students who will also meet the objec- 

tives of their institutions and of-society. 


The remaining five chapters of this special report present a review 
and synthesis of the literature concerning the. medical school- admissions 
process (and related issues) that has ,been produced over the pas® twenty 


years. ’ 
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CHAPTER II 


LOGISTICS OF-THE APPLICATION, pROCESMa 
a, 5; \ 


, . _ ; 
. - r? : ie a 
a: Pace °* , é ig 
Ro . . . é 
Ds e 


As reported in the previous chapter (Historical Overview), the:past - 
two decades have seen considefable change and evolution in the admission 
process to medical school. Particularly since the mid-sixties, the a 
logistics of the application process has become vastly more complex due. 
to the increase in volume of ,applications , (see Table 2.1). The increased 
complexity necessitatet a .refinement, and sophtstication of the entire 
procedure. - - ae 64> 

The major technical aspects of the application process have béen, 
examined in this. literature review; and it was found that many ‘changes « 
have’ occured in a) the computerization of the application process ; 

.b) paperwork processing; c) timing of the appJication process; d) process- 
ing costs and information dissemination to prospective applicants; and 

e) recruitment programs. The latter two ‘types of changes, in particular, 
were found to have facilitated the increased application of students from 
groups previously underrepresented in medicine. 


» : > ) 
Computerization of Application Process » 
\ 

, One of the most significant changes which has affecte all of these - 
elements was the development of the American Medical College Application 
Service (AMCAS) in the “late 1960's by the AAMC. By using this service, 
"applicants to AMCAS-participating.schools. initially submit only one set 
of application materials and official transcripts, regardless of the 

. niimber of schools to which they are applying. While AMCAS does not ren- 
der any admissions decisions and does not*advise applicants where to 
submit applications... (jt) benefits both the participating medical 
school and the app}icant by collecting, processing; and coordinating data, 
effectively reducing. the time and, in many cases, the expense of the 


‘ 
——, 


- application, procedure” (AAMC, 1976c, p: 22). . R 
-°Students applying to schools that do not participate in AMCAS pay. an 
average of $20 per application. Some AMCAS-participating schools, 
however, do charge an additional fee of their: own. AMCAS provides a 
service fee waiver program for applicants from families whose inabjlity 
_ to pay the AMCAS service fee would prevent them from applying to medical | 
‘school. Many individual schools also make such allowances in reference 
_to their own’ app}Tcation “fees. we ys 
6° * 
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= TABLE 2.1 


“Application Trends for Classes Entering U.S. ’ 
Medical Schools in 1955, 1965 and 1975 A 


: 9 ao A 


' 1985 | 19651975 
Number of Applicants 14,937 18,703 42,303 
~ Number of Applications 54,161 | (87,111 366,040 
° - , : ; . a. . “P 
Applications per Individual 3.6 eo” Ae. 8.7 
|. * * * ok * * ‘ 
” 2 , co fos 
} ‘ ; - Ron 8 
Percent Increase 7 
| 1955-1965 - 1965-1975 
«Nymber of Applicants : 25 .2 126.2 - is - 
60.8 320.2. 7 


Number of Applications 
30.6 85.1) 


Applications per Individual a) 
A __<__————— 


~ Sources: AAMC, Applicant Studies and App licartt Batagrams | a 
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Aleng with the deve lopsent of AMCAS, coupuberdzed saotieaeen systems 

were being used by at least one state school system (Rankin, 1972) and*. 

"many individual sohools were using computerized methods for information 
retrieval and/or data analysis in their admission process" (Rosenhol tz 


> and Andreatta, 1974 p. 1059). 


a audi a suey cofiducted in 1965, the AAMC found ‘that about a dozen 
schools employed a computer: in the admissions process (Thoripson , -1968). 
Thirty-seven percent of all medical schools anticipated using. computers’: 


for these purposes in’’the future. Rdsenhol tz and Andreatta described .« ° 
_ ways in which,medicalt schools- could integrate thei” computer systems with 


‘AMCAS thereby providing themselves with a highly sophisticated data-base. 
Thus ,« "the Admis's ion, Committee chairman, for example, (would: be able) to 
provide | daformation quickly to any or all OF the following, _ oe 
ul Individual commi ttee members : ‘concerning thé specific ¢ can= oe 
- didates they interviewed. ° . ee : 
ae " bots s 
2. The entire committee, noting its pecent actions and ove rall 
. actions to dateythe work yet to bé done, or the récords of 
selected candidates to be discussed gt: an upcoming meeting. 


3. 0 fice staff about the applicant pool, listing. ‘systematically 
me n alphabetical or numerical order key sub-categories of: the 
“processed or to-be-processed el _ Umpenholts and -— 
‘ Andreatta, 1974, p . 1060) 


a4 Much earlier than this, some medical: schools were eat reporting 


success in the use of computer systems for processing app¥fcations. In 
1963, the Admissions Committee of the Downstate Medical Center College 
of Medicine began experimenting with the use of a computer system to 


- compile application information (HiT and Siegel, ag The. schaol 


‘found *the systeh extremely uSeful in several area a grouping appli- ° 
cants according to their objective+records (GPA' s and MCAT scores), - 


‘b) heJping to manage the selection. procedure, c):rapidly assessing the , 


State of the pplicant pool, d) providing data for admissions research, 


~ and e). keeping the applicant ,informed ‘of his or, her Status. 


Rim, Pazdral, and Sine (1968) described a ‘ compaterized system used 
‘at Marquette Medical-School. ~ This’ system was utilized to "queue" appli- 


_ cants for interviews by weighting various factors such as MCAT: ‘SCOFES 5. 
| GPA, and undergraduate college*sefectivity. 


In 1973, Ambros ino and Brading reported on “an exper iueitalls, analytic’ 


computer-based methodology. for determining the interview Status of medi- - 


cal school applicants" (p. -332) at the Albany Medical College. The - 


College had "experienced over a 65 percent ‘increase in applications since = 


the 1969-70 application season" and therefore was in need of some form af” 
computer assistance in handling the DasstNe volume of Sap liceriane: 
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Stepwise uitiple regression procedures were used on quantitative , 


variableg taken from each student's application to predict the academic 


- quality f a student's preclinical years. . On the basis of this predictio 


oo 


it was’ then decided whether. to interview the. applicant as soon as possibl 


(if his/or her academic credentials were clearly: acceptable), to reject 
the applicant inmediately, or ta examine the applicants' credentials more 
carefu} ly ‘before making a decision. In the experiment, the results (i.e. 
the admissions decisions) predicted by the computer-based procedure were 
compared with the results of the admissions committee; and it was decided 
that /with further refinement of the a oyeten its accuracy would 
make it well worth utilizing. | 


In an editorial dealing with the above study, Peterson (1973) points 
out some of the controversial aspects in this type of screening method. 
The argument he puts forth is based on the fact that admissions commit- 


tees really do not know what constitutes a "good doctor" and there is 


little concrete evidence that grades in medical school correlate with 
physician performance (Wingard and Williamson, 1973). Therefore, to base 
the initial screening on quantitative predictors of preclinical grades 
could be interpreted asa poor method of evaluation. Goldhaber (1972) 
also critized the trend toward automated initial screening. of applicants 
because of its reliance gn.MCAT scores and,GPA's...The problem, however, 
is a complex one with practical, logistical considerations playing an 
important role in the equation. A review of the literature involving the 
range of criteria, predictability of criteria, and weighting systems usec 
is »provined 4 in subsequent’ eure, 
PA 


Paperwork Processing 
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“When the number of -a f applicants first began to escalate dramatically, 
Johnson (1965) recotmmendéd the use of preliminary application forms and 


ae wider’ use. of=the Early Decision: ‘Plan. Green (1966) reported that nine- 
‘teen medical schools ‘we ig a preliminary applicatign form in order 


to cut down an. the paperwork, time,*and costs involved in processing 
applications. Appearing ‘on these. forms. is only that information which is 


-used by the adniissions committee ‘for preliminary screening, usually GPA 


of premed science courses, MCAT scores and state of residence. If an 
applicant passes this phase ‘of the:screening. process, he or she is then 
asked to submit. a:full-. applicatiof-which includes complete transcripts, 
letters of. recommendation, a personal statement, etc. As noted earlier, 
this - two-phase’ typé’ of- systém has: its. critics. (Goldhaber, 1972; Peterson. 


_ 1973) since the initTal screening is based mainly on quantitative 


criteria. However, most. schools which utilize a preliminary application 
form: are willing to reconsider applicants who feel that their rejection 
tn this initial screening phase was unfair and that a full: application» , 


‘would better explain their background. ' ‘ 


<5 


Teitelbaum, Elstein, Rex et als (1973) report. on related efforts by the : 


. College of Human Medicine at Michigan State University to streamline their 
_admissions process. The admisstons committee stipulated the variables to 


be used in the decision-making process and the weight to be given to each. 
An Application Rating ‘Form was then devised which incorporated these .var- 
jables. These rating forms were completed for each applicant by two 


administrative staff mémbers, rather than by members :of the admissions 


committee. Those applicants who received scores of.36 points or higher 
were sent Secondary applications to complete and were asked to submit 
letters of recommendation: These materials were then scored and, on the 
basis of their combined scores, applicants were either asked for an inter- 
view or put into a hold category. The interviews were all conducted by 
members of the admissions committee who were responsible for evaluating 
the interview on ar Interviewing Rating Form. The interview score was 
then added to the overal] score, and the top ninety applicants were 
approved for admission. According, to the authors of this study, this 
procedure reduced‘the cost of processing their applications from approx- 
imately $3000 per appl?cant to approximately $800 per applicant. 


Several studies such as those by Motto and Werner (1965b), Jackson and 
Kellow. (1958), and Litton-Hawes, MacLean amd Hines (1976) have dealt with the im- 
provement of the admissions interview. These will be discussed in Chapter 
IV. Those studies concerning the use of weighting systems will be dis- 
cussed in Chapter V. 

- In spite of the continuing sophistication and streamlining of the | 
admissions process,-some have expressed the need for: further changes. 
Cooper (1953) and Marcus and Riggs (1974), among others, have suggested : 
the development of an admissions matching plan similar to the computeriz- 
ed National Internship and Residency Matching Program (NIRMP). However, 
as Ceitham] (1974) and Green and Johnson (1972) have pointed out, in the 
case of the NIRMP there have traditionally been more internship and 
resjdency places than there have been students to. fill them, whereas in 
the medical “school adfri ssions process there are far more applicants than . . 
places. Accordingly, a matching program might enlarge -the number of 
applications and therefore increase the workload of admissions.~committees. 


In 1972, the AAMC Council of Deans recommended that "the Association 
President and appropriate staff explore’... the feasibility of a medical 
school..admissions matching program." A pilot program was subsequently 
conducted and -a summary of the results and recommendations were as 
follows: 2 

Advantages | , os ave oe ; 
@ For medical schools, the only discernible benefit 
of matching might be the reduction of paper Work -asso- - 
ciated with sending letters of acceptance and keeping - ee 
records of responses. — — es | ee 


ay: yt 
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e For. applicants, matching might--if appropriately 
_ timed and used by a “sufficiént number of medical schools-- . 
. : - «reduce current levels of anxfety. 
nieaeijanbaaes . 
; e Matching sion would not detrease the total volume 
- of applications, which is the crux of what has been 
called os "admissions crisis, " 
e Matching would require strict adherence to rigid 
deadlines for submission of rank order. lists by both 
applicants and participating schools. School rank 
order lists would probably have to be submitted to the 
‘central processing office not later than April}. dt 
would therefore be necessary for all participating 
schools to have completed all application processing 
and interviews and to’ have ranked an appropriate num- 

y ber of applicants by that date. This might be.a ; 
serious problem, particularly for schools which nor- 
mally offer many more acceptances than there are places 
available in order to Fi a class. 


e@ Qne aspect of the ieatchina process which has 
a assumed increasing importance during the course of the 
pilot program is that of "balanced classes." It is 
- technically possible for the matching algorithm to ; 
‘ , . take into consideration such applicant characteristics 
aS sex, minority group, and state of residence. In * 
order to achieve a desired mix of students according 
, to these characteristics through matching, however, it 
Ps would be necessary for medical schools: to divide sub- 
sets, in effect establishing quotas for each- group. 
It is probable that this would be inconsistent with:. 
current legal trends. . air 
e It is estimated that the costs related. to devel- 
‘ opment, school and student education, programming and 
processing of an admissions matching system would 
* total $500,000 at a minimum. 


In summary, it was concluded that matching would ~~ 
seem to offer more disadvantages than advantages to 
medical ee admissions- processing. In addition,. 
the intr®duction of admissions matching at this time 
would likely impose new stresses on a System which ‘ 
has begun to accomodate to the “crisis"’ conditions _ 

. - observed three years ago. ("Report of the AAMC.. oe 
an 1975p. 7) . ee 
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“a 
“It was therefor to Saiuch the admissions matchihg ‘proposal 


RECS . 


yrs . . ‘ 
an the AAMC pilot program proved that an admissions ene 
Was . techhical ly feasible but impractical on a national scale,éthe Univer- 
sity of Texas. System found, through their own pilot admission matching 
. program, that "admission matching: can and does work efficiedtly for’ 


‘schools which share: to’ a great extent a common willingness’to work-togeth- | 


en (Padgett, Rankin, ‘and Knisely,- 1976, p. 486). Because of the success 
of their pilot study, the Texas. University System decided to implement 
such a matching program. {gure 1 illustrates the Admission Matching 
System flowchart for the University of Texas medical. schools which is in- 


cluded: in each ‘application packet. " 
: | , 4 : d rere ( 
m _— Timing of ‘Application Process 
“eS ' : | 7 . : : . 
“hs 


e- : 
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In spite of the controversial issues ‘they may raise, the widespread 
use of data-processing and preliminary application forms in the applica- 
tion process have helped alleviate many problems , not the least of which 
is timing. Schedules and deadlines are more easily met by both the 
applicant (with the use of AMCAS) and the medical school (using AMCAS and 
individualized systems). However, the actual timing of the application 


‘process was a problematic issue long before the escalation of applications 


cin the 1960's. At one time, it was not uncommon for some medical colleges 
to -accept students and require sizeable nonrerunadb ye deposit. fees more 
than a year before matriculation.. . : 


’ SL sKAMC helped to solve most of sidsk peak by issuing recommenda> 
tions at: ‘several points in time which would standardize the so-called . 
_"traffic rules.’ Johnson, Levitt, Little, and Morris (1963) reported that 
“as early as 1949, the Executive Council of ‘the AAMC agreed that medical. 
colleges should not accept applicants more. than. one year before their . 
matriculation as medical students. In‘1952, ‘the Council added its .dis- 
approval of: the practice of requiring deposit, fees prior to the January. 1 
of the same year as entrance to medical schoe]..”. In 1953, the AAMC insti- 
tutional membership approved the Councils, ‘reConmendations and in'1954 
the "traffic males were adopted” almost unanimous ly by this ‘group. _ . 


As’ shown in Table 2% oY the 1954 “Neratfic: ‘rules" set the deposit fee. 
deadline date at January 15, sand the maximum .déposit at $100.- By 1960, 
the "traffic rules" were modi fied to meet the needs ‘of ‘medical. schools, 
with experimental programs and were retitled the "Recommended Acceptance 
Procedures of the AAMC." These procedures have :since been revised peri- 
Odically and are published each year “in Medical ‘School, Admissions‘ . 

Requirements (MSAR) (see Tables 2. g. ant non for: r the’ ye and 1976 recom--- 
mended: acceptance nce procedures). 
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The University: of Texas Admission Matching System* FFowchart 
: Diagram that is Placed in Application Packetsry 
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y JANUARY 1 1977 
° 


JAN! [APPLICANTS STATE THEIR 


SCHOOLS SUBMIT 


1977 [PREFERENCE FORSCHOOLS| .'. . PREFERENCE LIST OF! 
- ob. JAN 10 [PREFERENCE DATA IS INTERVIEWED 24 
. 1977 ERIFIED BY APPLICANTS 4 


APPLICANTS . 
a ee P 
MATCHING CONDUCTED 


ACCEPTANCE LETTEAS’MAILED 
BY SCHOOLS TO APPLICANTS 
JAN 18. 1977 


ae eee: 


* RESPONSES TO ACCEPTANCE APPLICANTS 7 
LETTERS RECEIVED BY ACCEPTED BY THEIR 
ISCHOOLS BY HIGHEST CHOICE 

JANUARY 31 1977 UT SYSTEM SCHOOL 


PEASONAL °° + 
INTERVIEWS BETWEEN 
JAN 1 AND FEB 1* 


ne ie os : 5 
? 4 
‘ \ an 
‘ 
: Si ere rer APPLICANTS STILL IN MATCHING DE TERMINATION OF NUMBE 
FEB! APPLICANTS STATE 2 DE TERMINATION OF NUMBER 
‘ees 7 ON to lente roots |_| Manes cnoices By WithORAwal > 
> | WIT Hi A 
phen ae ees | 2 IN PRIOR MATCHING, BUT SCHOOLS SUBMIT ~ 
vorr ; NOT MATCHED . PREFERENCE LISTS 
Panacea: 2 INTERVIEWED AFTER JAN 1 are 
: fad WoL Lk 
MATCHING CONDUCTED 
. FOR REMAINING PLACES 
: ACCEPTANCE LETTERS : 
. Sok p MAILYO FEB 15 vorn | a” ‘ . oe 
. , ' ‘ > 


APPLICANTS 
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= UT SYSTEM SCHOOL 


* eee aoe = a rare: 
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r aoe APPLICANSS STILL IN MATCHING Sigs es tr macs eal 
APPLICANTS STATE yy MATCHED BUT NOT TO ETERMINATION oF HUMBER: 

PREF FOR SCHOOLS : OF PLACES VACATE 
> |, HIGHEST CHOICE BY WITHORAWAL 


_ |REASONAL*t RESPONSES TO 
7 ‘ INTEAVIEWS BETWEEN ACCEPTANCE LETTERS, 
FEB 1 AND mance "| 8Y MARCH 19977 


© MARCH |PAEF DATA VERIFIED '2.4N PRIOR MATCHING BUT - » 'TSCH' JAMIT 
: 10 1977 | BY APPLICANTS | NOT MATCHED | PREFERENCE TISTS 
wee ee noe eee = f3 INTERVIEWED AFTER FEB 1. ee —J 
ro aon . 7 oa i per 
. : x 5 
; - |MATCHING CONDUCTED !'; 
‘ FOR REMAINING PLACES > 
= : ACCEPTANCE LETTERS 7 ese 
? i ‘ MAILED MARCH 15 1977 |- ' y 4 
. * ier me eee 
a . + Ld e 
3 7 o ' we . 
a 8 bee ‘ "ot 5 fo APPLICANTS ¢ 
: ; . , . "RESPONSES TO =i > , ACCEPTED BY THEIR 
“ Nel anaes . ACCEPTANCE LETTERDL “----——-. HIGHESY CHOICE 
yi A BYAPAM L977 || UT SYSTEM SCHOOL: 
aa . ro a . . * 2 Pare | 
= * MEDIC AL SCHOOLS AEOQWAE . 3 t 3 
AN INTERVIEW BEFORE." * : . y 
4 * OFREARING AN ACCEPTANCE ks SED ia : Ae 
b ve IGAN ACCE . VACANCIES OCGURAING : , : 
: AFTER MARCH 45, (977 - 
- TTA FEW APPLICANTS MAY RECEIVE P 
: THEIR FIRST INTERVIEW AFTER OCCU ED ASHES 
wl *, JANUARY 1 1977 post 4 . 
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Source: Padgett, Rankin, and Knisely, 1976, p. 180. 
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. ’ : : , -% : 
; ; 5 . ACCEPTANCE PROCEDURES—TRAFFIC RULES ° 
= . : approved in 1954) : 
x bs . “y - 
x ; 


year before the nchint start of Instruction for that class, 


e e 
1 Ne qdace in the treshuimn cliss shad) be offed-a ‘= pplicamt aaere thaw ont 
2 a ~ , 


WMollowlng the reeelpt of an offer of a place in the freshnawin class, i stucent 
shall be allowed itt past two. weeks in which to make a written reply to the medical 
school, ‘ F 


ad. Pritr to Jknuary 15. this written reply may be either a deqlarauion af intent 


or a formal acceptance of the plate ollered. When the applicant ‘has devhared his 

t cohtinued Interest’ wilhin the two-week period, the medical school agrees to hold a 
place for him until Jaiuosy 15, Sunless: he indicates. that he bas been aecepled -clse- 
where and withdrnws bis applleattag. Toemiy, of course, iid often Wil, enter date 
furinal arrangements with’ the one medical school uf .his choice before January 15. 
Becmuse of the wide variedion dno the ceceptan®e dates of diVerent MWedleal schaols, 

: sume students will wish*to ehunge their minds after filing a devlaration® of intent and 

. ft is understood that nothing unethical is implied when a student does so change bis 
tnind, In sueh an event, the student Is obligated to send prompt written noWficatinn 

: tu every school holding a place fur him. ¢ ‘ 

a 2 


“4. The payment of a nonrefundable deposit sWall not be required of any: appli 
capt prioy ta Junuary 15, ‘ “ e { oe Ua, 


; “5S When a student tity a declaration of intept. a refundable deposit—nat to 


+ exceed $300 ~may be required iat Che discretion of the School granting the acceplanre. 
Such deposits will be refunded without question upon request made prior to January 15. 


a : { ; 
. 6. ‘The deposit. when required to held a glace in the freshman chiss after Jan: 
ary 15, shill “er $100 


aS 


. 


e i, ‘ i ’ 
. oe ‘ 
| 7. By January U4 cach applicane for whom a place in the entering chasis heinig 
held must other accept the offer formality and pay any required nonrefandable deport 


cor WDE brah cw bens cegapedde apt neeny . 


. 8 x KaQllgywing Janunry Da, an appieant offered a place inca fgeshman class waist ‘ 


elther formally accept or orefuse the place, but he shall have al least (we kwecks 
dn whieh te decide Dtqosits minde after Jsnmugry LS shajl be nonrefundable: 


eo *# : art . é ™ . 4 .8 : 
. ‘ * . 7 wv . . . 
: en 9 To assist the medicul schvdls, the AAMC office will compife a list ‘of the 
cae ‘ students whe huve formally aecepled sc pelace doothe freghnicn chiss ‘This dist will te 
7 : Hat buided abeut Mebriney dyad will he hept curréat by Drequent: revisions, 
te oy te anf, car . 
. . 4 ot \ . * se ° ry 
r j Fy 


A = ‘ 
*Thene ure the fecoummensded procedures of the Executive Uouncil ‘of the. Assucisvun 
Medical Celleges and Nave -been approved: by the membership of the Association 


of Amprhan, 


These ov walled 


7 traMe avles mre now observed -hy mast medicul schools. ay 
. aE : 
> . - o) / 
“a as * es . ‘i . 
ay j C : t 


Source: Gee and Cowles, 1957, p. 199. ° ” 
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For the information of prospective medical students and their aulviyers; the reconimended 


. 
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“TABLE 2.3: 


~: 


Recommendations of the AAMC C oncerning 
Medical School Acceptance Procedures 
(Revised September: 1975)- 7 


procedures for Rgolfering acceptance to medical ychool and Jar student respohves to those of- 
a are p rintet “below: Pa : 


*3, 


wg the “ 


lrach medical school should prepgré and dis- 


tribute tu apphreants and college advisers a - 


detailed schedule of its applicatio® and ac- 
ceblunce procedures und should adhere to 
this schedule unless it’ is publicly amended. 
Each, medical school should agree not to 
nolily ity applicants (except for. those apply- 


ing via EDP) of acceptance prior to Noyem- 


ber 15 of each admigsion cy cle. 


An ‘applicant should be given at least two 


wecks lo reply tv an ofler of poviseian: Alter . 


that time, un applicant may be required od 
file a statement of intent, or’ a dxposit, or 
both. Phe statement of intent: should Provide 
freedom to withdraw ub the applicant iy later 
accepted by a school whiclt he or she prefers, 
the deposit, Which should not exceed. $100, 
should be relundabl¢ without questioa, The 
refundable depyrit may be credued against 
tuition charges SP the appheant matricujates 
at the school. 


Nosiedical schoal should use any 
which iuphes that teceptamuce af a otler 
creates aoiiusal obbpation, ta mati tbate at 
that schoul Every accepted appheant shoal 
be free tw deal with abl schools and to atcepe 
anallee trom une al them even thoaigh atale 
posit has been paid toy another scliast bvery 
aceepled applttant does retain under all cre 
cumstances an obhiy, Awol to nauly a school 
Promptly wl e decision nue lo agcepl tly ofler 
and to withdraw at once if 
un after tooth one achoul, 

egies “and accepts qn aller trom another > 


school - : 
oe 


aller jecepting 


the appheant ree 


5, By April lo an appleant who has, received 


pfters of admission trom) more than one 
school and “has, reeeived all financial aid in- 
formation from the schools necessary to make 
a decision und has had at least two weeks lo 
consider each offer should choose the one 
school which ‘he or she prefers and withdraw * 
from all other achooly at which he of ‘she hats 
been accepted, 

y. Each school is free to Snake appropriate ules 
for dealing with accepted applicants who, 
without adequate explanation, hold one or 
more -places in other schools, These rules 
should recognize thy problems of the student 
who has multiple offers and also of those ap- 
plicunts why have not yet been accepted. 


7, Subsequent to June Ira medical school seck- 


ing to admit?an ypplicunt already known to 
be accepted by another school fur that enter- 
ing class should advise that syhool of tls in- 
tent. Because of the sdvinnpaive problems 
tavolved in filling a place vacated just prior 
to the cOmMencement of the academic your.” 
schools should communicate fully with each 
other with respect to-anberpated fate roster 
disinges ih order to keep misuhderstandinps 
ate dinimun 


K MMfter an appheant has actually corgtled aa 


US. medical school, no Hprther aeceplaices: 
should be ditered to that individual Once 
enrolled ina school, students have da oblipa- 
hot to withdraw -their applications prompuy 
fren all other schools barallment is defined 
as being officially: registered at a school on 
oft dubsequent Us the: formally publicized 
Stafting date for The firleyear class of that 


+ suhool. 


*Most of these Ivy procedures do net pert aD students accepted under Qe barly Decesteon Min 
IEDR) because such stintents apiece in ddteunee to “ailend a pyveet medical a heutdt ollered a phace ata 


cathy dee tytn” 


i 
ry - ‘ 


sep men af thie apple AULIOHE y taut 


“%, 


we 


(AAMC, 197%6c). - 


: | en coe Nes 


In 1973, a four-stage plan wigieveToped by the AAMC to help alleviate ; 
the problems caused by an over-abyndance of applicants and applications. 


The. four aspects of, this plan included: a) better information dissemina-~”" 


- » 


o 


"> tion to applicants and preprofessional advisors: which would help to cut 


down on the number of applications filed per applicant; b) development of 
an Early Decision Plan; c) uniform acceptance dates; and:d) rolling ad- 
missians (Johnson, 1973). oye “8 wo, 


co. ‘8 : “ee : 
; Following the apove recommendations, many schools naw‘ uSe’ some or all] - 
of the AAMC-Suggested Uniform Acceptance Dates for notifying applicants of 
their admission to medical school. These dates are currently December 15, 
January 15, February 15, and March 15. The majority of. schools also have 
agreed not to notify applicants (except those applying through the Early 
Decision Plan) of acceptance prior to November 15yof each admission cycle 


a 


The Early Decision Plan (EDP), which began nationally in 1973, permits 
an applicant to file a single application (usually prior to: August 15) and 
guarantees that the applicant will receive a prompt decision by-that . © - 
school (usually on or priof to October.1). Should applicants not be ad-. 
mitted as-an early dectston candidate, they may be reconsidered by that 
school as a.regular candidate and, of course, may then apply to other 


- Schools... Applicants who opt for early decision may. not apply t@ any other 


U.S. medical school during the time their.credentials are being considered 
for early decision, and if admitted to an ‘early decision school, the 


‘applicant must then attend that school. -If not admitted, the applicant 


may:.then apply to other schools. 


ofr the 1976-77 ehtering class, 58 schools accepted 884 students under 


- by theAnedical schools.: 


> financial 
‘§chools." 


EDP from a total of 2,141 applicants. Since the average applicant cur- 
rently files 8 or 9 applications, however, this represents @ saving of 
over 7 applications which would otherwise have had to be. processed 


~ Acéording to Medical School Admission Re uirements (AAMC, 1976c, 
p. 30), "As EDP becomes even more widely understood by applicants and 
their advisers, it is anticipated that the number of EDP. applicants 


and acceptees will increase.. The newly-established November 15 first -_ 
acceptance date for regular candidates shquld also..eneourage more wide- — 


spread use of EDP. [t should be] emphasized,;: however., that-only applicants aay 


with a clearly excellent chance pf admission at a particular’ school are 


.- advised to apply under EDP becatse mo$t participating schools ‘admit only ; 
. -a-smalt portion of their class ( to #6 percent) through:EDP. - For such — 
Strong fan sx however, admiss hon. 


nder EDP can greatly reduce the 
lying to muitiple medical 


and psychological, costs fe) 


Consideration has also been given to multiple <entry points (e.g., 
advanced placement through qualifying exams) (Magraw, 1969, Mahoney and 
: | A 


4 
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. the "four stage plan" (Johnson, 1973) mentioned earlier; the. 


. 
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and Engelhardt, C5 and to semiannual admissions (Rittenhouse and 


Weiner, 1971). Zhe literature on this subject, however, pertains 
‘mainly to its,effect within the medical school: (e.g. on faculty,” 
emer unes “etc. ) rather than to the peel ication process. 


4 : 1 


Processing. Coste. and Information Dissemination 


S 


“A related problem has been the high cost of withsessing the Papialy is 


rising number of applications. In Rosenberg's (1973) ‘study of fo 

medical schools, the costs of the admissions process ranged from $49,000 
(to admit a class of 93 students) to over $200,000 (for 140° students). 
"These costs include budgeted expenses such as salaries, for professional ~ 
and nonprofessional personnel, printing, mailing, and travel: and ‘resource 
expenditures for such matters as faculty time: at admissions’ committee oa 
meetings and interviews" (p. 707). . 


e 


. 
In order to reduce these costs while iaintsining the’ school ' S. 
admissions objectives, Rosenberg suggests: sa) pubJicizing general 
criteria by which apppicants are selected; b) using a one-page’ summary 
sheet as a preliminary screening process for each applicanty ; - . 
c) utilizing the interview.in amore efficient, manner by eer ge tty" 


e- 


_ only those for whom additional information is needed (thus prectuding’s: 


those wha would either definitely be accepted or rejected regardless Of. 
the interview), and by being as’ specific and ‘objective as possible’ in’ 


_ evaluating the interview; d) ranking each applicant who passes the’ 


preliminary screening along a continuum, assigning eacW.a specific « | 
number of points; e): including the summary sheet in the file of those * - 
accepted and later adding measures of the student's’ performance in 


'. med#c4T school. -These sumfary sheets could then be used ds feedback to 
“the committee on bb validity of their decisions. 


AM of the above suggestions concern. procedures which are already 


in use:in some form. The AAMC, for example, disseminates information to’ 


applicegts through several sources. Particularty.since the proposal ‘of: ee 
edical . 
School Admissions. Requirements’ (MSAR) ‘handbook published by tye : 
as contained an increased amount of both national and individual school 


“information’on the characteristics. of the most recent. entering class. 
‘ These * ‘charaéteristics hdve included GPA‘s and MCAT scores, undergraduate 


major, age, sex, residency, and minority group composition, as well as 
a wealth of other information valuable to applicants. Such information 
permits the potential applicant to compare his own credentials with those: 
of the most recently accepted class and to estimate his own chances of 


> 


being accepted. The assumption is that°obviously unqualified applicants ~ a 


will, thus, be discouraged from applying to those schools where the 
likelihood of their being accepted is low. For several years, the. AMCAS 
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7 cally publishes Minor 


. related details ileal each medical college. ° , 


23-0 - 


te 1 eo" 


‘Information Booklet also tegtained. similar data for participating 


schools but this is now reported in, MSAR ‘in “order, to. avoid duplication. 


In. addition, the “Office of Minority ‘Affairs of the AAMC periodi- 
i Student Opportunities in United States Medical ° 
Schools (MSOUSMS : is handbook includes 

information on “minority. group recruitment , admissions, aéadettic aid, an 


7 . 4 


The Medical Minority Applicant Registry "(Mad:MAR) is nether AANC- 


, initiated service, which ‘began in 1969 (AAMC, 1970¢).. This program 


provides the opportunity for any medicat school applicant who wishes to ° 
be considered as, a minority applicant to have his basic biographical 
information circulated automatically (at no afidi tional cost to the 
applicant) to the admissions offices of.all U.S. médical schools, as well 
as to other health services _ondenizations and ee that request 
the Med-MAR lists. a . 2 

f 4 
Students are invited co farticinit ate ip "Med-MAR by identifying them-- 


‘selves as. belonging’to a_minority gfoup either on a questionnaire 


Pe eriecd Ss Haat. 


.completed at the time they take the Medical College Admission Test 


(MCAT) or by contacting the AAMC directly. Two Med-MAR lists are 
publishéd annually (usually in July and November) and are circulated to 
all U.S. medical schools. ‘Upon receipt of Med-MAR lists, medical . 
schools interested in further contact with given students correspond ‘ 
with ‘them directly and ae that they file more detailed application ° 
materials (AAMC, 1976¢) . : . 

In addition to the above sources of information, edch medical 
college publishes its own catalogué Which serves as another detailed 
resource for the prospective applicant. Thus, by making it as easy as 
possible for prospective applicants to obtain saccurate information on 
admission requirements, the AAMC and the individual -medical schools are 
assisting both the student and the schools. The students should be 
better prepared to decide realfstically whether to apply and where to 
apply, while. the schools should be able to reduce the yoTune of — 
InApPROpENALE applications. ° 


* ‘ = ’ 


Recruitment Programs 


ta . od 


.) 


Recruitment programs Sica play a part in publicizing the “general 
criteria by which applicants are selected and in dispelling misconcep-.  . : 
tions. he the past decade, schools have had far more qualified b 4 
applic n could be admitted, but previously most schools actively | 
From the mid-fifties to the early sixties, medical 


schools were losing ‘applicants to other science professions, especially 
with the pee popularity of = space program. . 4 


36° 


. 


» 


s 
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_ This problem was articulated by Various participants in AAMC's = 
Fourth-Annual Teaching Institute (Gee and Cowles, 1957). at. which much 
of the focus was on the dearth of qualified applicants to medical 

- schools. Some. state-supported medical schools, with residency restric- 
tidns among their admissions critefia,; were especially hard-pressed to 

. find enough qualified applicants to fill their entering classes. 
Fifteen percent of the participants (who had-all filled out a lengthy. 


-questionnaire.just prior to the meeting) considered recruitment of...) ° 


potential candidates a serious problem, while 43% considered ita 
ttle problem and. 41% .felt.it to pe little or no. problem (A 
1956). | en ee —_ 


. 
~ 


In 1965, the applicant pool had increased somewhat, .but many . 
medical schools were still seeking out applicants. Three senior medical 
students at Western. Reserve University School of Medicine (Argrison, 
Baumann,-and Aronson, 1965) describéd the manner.in which ical school 
applicants went about choosing a medical school and suggested that 
medical schools utilize: this information in recruiting students. 


After tabulating the,resiM{s of a questionnaire sent to all four 

- cldsses. at Western Reserve, Aragéon et al. found that the three. sources 
of information which students corSidered most valuable in their deciding 
to attend Western Reserve’ were the school catalogue, the admissions 
cq@mittee interview, and other medical students. - The four most 
important types of information influencing an applicant's decision were: 
the school’s general reputation, the teaching program, the school's 
‘geographic location, and advice from primary sources of information 
a. interviewer for the admissions committee and WRU medical 
students). Secondary sources of information (including premedical 
advisors, parents, friends, relatives, home town physicians, and WRU 
aJumni) were’ not considered of much importance by the majority of 
students in deciding to attend WRU. 


The authors concluded that admissions committees should: inake 
. maximum use of the interview in acquainting promising applicants with 
the college, its programs, teaching methods, type of student body, etc. 
and in encouraging applicants to interact with.medical: students while 
visiting the campus. This, in conjunction with improving the college's 
catelogue, would help to entice more good applicants into enrolling in 
their medical school. : 2 . 

In recent years, much less Glen recruiting of qualified appli- 
cants has been needed at most schools. Instead, the recruiting which 
has been done has focused on students from those papulations previously 
under-represented in the medical profession, particularly minority 
students and applicants from rural backgrqunds. 
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: ults, of a westionnaire distributed by the AAMC in July, — 

- 1968 shee Gis aos neds schools were then primarily concerned with 
recruiting Afro-Americans ,’ and two-thirds of the schdels indicated that 
they had developed special recruiting actdvities for racial minority —— 
group’ members (Jarecky, 1969). ‘Whilé most of the literature on’ this 
subject calls for medical schools to develop better recruitment poate h 
for minorities (Hart, 1974; Henry and Sinkferd, 1972; Kaplan, 1970; Josiah. — 
Macy, Jr. Foundation, 1971; Blue Spruce, 1972, Buxbaum, #972; AAMC ,.1970a; 
Sayles, 1975), some of the literature describes: existing minority .recruit- 
ment programs (Curtis, 1971; Ramsay, 1973; Diekema, 1974; Smith, 1974; 
Gaines, 1975). In addition, various reports examine summer programs 

+» which stress academic, study skill, and career guidance for educa- | 
tionally and economically disadvantaged students (Jackson, 1972; Ramsay, - 
1973; Ortiz and Kender, 1974). i , 


Some. schools are also in the process of developing programs specifi- - 
cally aimed at the recruiting of rural applicants in an effort to sa 
increase the number of their graduates who will eventually go back to 
rural areas to practice. Aaron (1976a) reports on a program in I]linois 
to recruit students from rural backgrounds (see Chapter VI). aa 
Research conducted by O'Brien and Bagby (1975) indicates that recruit- 
ment of rural applicants needs to start as far back as high school, if , 
these efforts—are to be successful. 


'. + Bt should be noted that while the need to recruit qualified non- 
\ minority urban applicants is no lenger a major problem, there is still 
’ a need for medical schools to more fully inform prospective applicants 
and enroltees dbout their part’icular institution and the type of 
students they’seek. A study by Gottheil, et al. (1969): 
"analyzed the effect of “lack of fit" between the student and the medical 
school on'the amount of stress experienced by the stltient’ in his/her 
. first year of medical school. They found that the accuracy of a 
student's preconceptions of the medical school influenced the amount of 
stress and dissatisfaction experienced in.the first year. Those 5 
students whose expectations had been realistic fared better, academically 
and non-academically, than did those with inaccurate préconceptions. 
The authors stress the importance of matcliing students to the type of 
medical school environment in which they would feel most comfortable. 
This, the authors feel, can best be done by improvements in recruitment 
programs and information dissemination. : 


_' - In a survey, conducted for the AAMC’s Group on Student Affairs by 
Roger Lambson (1975b),52% of the student affairs personnel at U.S. 

, medical schools reported -being involved in recruitment of students, and 
» 41% -ranked recruiting as one of their top three responsibilities. This 
suggests that, even with a surplus of qualified candidates,: medical 

- schools still try to recruit "the best" for their institutions. 
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In summary, the last two decades have seen many changes in. the 
logistics of the admissions process due to a vast increase in both the 
‘number of applicants and the number of their-applications. Individual |. 
schools have refined and streamlined their methods of processing 
applications and continue to do ee deve lopment. of AMCAS and the 
use of computers by individual scho has greatly helped ‘in paperwork.. - 
_  w processing as well as in’ other aspects’ of the application PYOeess. 


a os “ - The-AAMC/traffic rules" have reduced the problems related to. . 
» timing and to deposit fees and have made the application process more 
uniform. Preliminary applicatign ‘forms have helped reduce’ paperwork 
- . and costs, and the Early Decisign*Plan has made life simpler for some 
applicants and admissions committees. In addition, individual schools, 
- i we]] asthe AAMC, have expanded their efforts to collect, analyze 
d disseminate data which will be of help to both applicants and & 
admissions committees. Sirice the late 1960's a special effort has 
been made to inform*minority.:groups. of the opportunities in medicine 
and to demythicize the ‘admissions process for.those population groups 
who are underrepresented in medical schools. 
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Several other solutions to the admissions process have been pro- 
‘posed over the years,.the more radical of them being (1) a lottery 
system, (2) open admissions, and (3) quota systems (Green and Johnson, 
1972). It seems more likely, however, that the medical schools will 
continue to change and adapt their admissions logistics along the lines 
summarized in the previous paragraphs. . ; , 
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- admissions committee 


_ t Xi. 
ae COMPOSITION AND FUNCTION OF ADMISSIONS COMMITTEES - , 


The admissions committees of medical schools. carry. an waure of awe- .. 


> some power’ in the perception of each medical school. applicant. Those 
"outside of the actual admissions process. generally. have a preconicei ved 


notion pf what constitutes the "average" admisstons committee, and how 
it operates. In order to fully understand the form and function of these 
committees, one. must discard thé myths | surrounding them and -examine the 
reality. ; : 1 8 


‘en eh 
a 


Unfortunately, this. aeality ‘is. sonawhat-elusive since the Viterature: 
on this subject is. rather meager. Few schools have published reports 
describing the composition of their admissions commi‘ttee , how. the. 


. commit¢ee Operates, and how it -is structured. * Those reports ‘which’ have 
. been published in various state journals (Henn. and Carver, 1971; Hermann 


and Creek, 1971; DuVal, 1970; Schwarz, 1972; "Managing the University," 
1993); tend to be “one shot deals" in that they. are: not complemented 
with reports in -other years ‘for comparison vale ; ‘ 


-Funkenstein basi felt that "the admissions policies and eracedire 
of medical schools have not changed as rapidly as have medical -schools 
themselves, their students, or the demands of society" (p. 497). He 
chastised admissions committees for npt dealing effectively with the. 


‘ needs of a changing society, and urged its members to analyze their ‘role 


more closely, thus avoiding impending confrontation with atssattstied 
groups both in and outside of the medical school. : 


“~ s8 3 
ssess the amount of change that has gone on in’ 

since the social ferment of the late sixties. The 
terjal may indicate that.the. focus of congern is qn 


It is difficult tof 
lack of published 


.other aspects of the admission's process, such‘as. ‘the range of criteria 
-used, and ocae weighting: “ye a ua apg feants (Chapters 


IV and Vv). 


“Niévertuedesd. one eanniét ignore ‘the Vital ‘ole os ae 


commi tte” ‘plays in selecting our future doctors. Therefore, it is worth | 


.- examining what information can be garnered from the literature of these 


past twenty years. 


. , The Late 1950's 


. 


The most: comprehensive single source of ‘iforaefon on’ medical 7a 


school admissions committees is the Report of the Fourth mnie! Teaching 


on, 
.h 


(27), 


an 


of whom were also admissions committee: members) . 
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Institute (Gia, and cowless. 1957), whi chincludes ‘dats collected from a 
questionnaire sent to all U.S. medical. schools admissions committees and to 
severad non-U.S. schools, as well as to the conference participants (most © 


The datia collected for the Institute. covers a wide rahge of infors =. 
mation onthe admissions committees, from_size..and composition to-manier ~ 
of operation. Because this data stands as a landmark in the analysis, Of 
the admissions. process, - it is worth reproducing here that..which is 
pertinent to-thi's chapter, especidbby-since the Report: id no longer in 


print or othérwise gasily obtainable. 


The’ ‘manner of appointngyt to the sg cetons ‘colmittes was most. often 
. (66 percent of the time) by “the Deatmof the medic&l ‘college, with 52 
Percent: of the “se jex's being selected from thé clinical departinents and 
“41 percent fr basi science (Table.3.1). Moreover, they typically. 
included: admini$tggéive officers, and, not A#frequently, a psychiatrist 
(Table 3.2). The size of the committees ranged from 2 to 12 or moye:, 
“With most faking between 4-7 (Table 3. 3). tae 


" 
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ae While no data wae collected. on the. _average length of appointment: Eee 


“one can obtain atleast a general idea. ‘of the typical turnover rate by 
Panna Table 3.4. .However, «it should be kept in mind that the data 
in Table 3.4 deals only with the 40 percent :of-'schools who utilized a 

rotation plan and no tata is available on how the “other : 60° percent: went 


about oe Dae ee radi “ AE Gk 


oO, 
pe 


. were -admissions committee members*. It is therefore ig eet to note” 
— the-smal1. percentage: of. those * participants who were engaged: in research 
. and.patient care as: opposed ‘to. the significant number in teaching and 
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Naspects ‘OF ‘an admissions. ‘conmatitee? S work ‘consists of 
feations, cand, (b), developing policies.concerning °°» 
nts: and procedures .. In, recent years. emphasis . has’. 
iontening the “dmount:.df time: the committee. needs-td' spend 
on the former, cL ‘phiderr to free more ‘Cine for, the Jatt Tr RSenper gs 
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*This assumption. Mh: giiso’ confirmed ‘by: “he hitd author 3f” ‘this ‘report wha. 
paste iw rh it he vd 
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Total g {n each rank 21 
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. Source: + atey, 1957, -p. 184. 
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TABLE 3.1 


TEACHING "RANK AND OEPARTMENT OF ADMISSION COMMITTEE” Tens, 


(Comte tteé members group) 


Chairman 


Professor 


Associate - 
professor 


inca: Sage 
Me di cine sa 1 
Obatetrics-cytacalony ] 
7 od 

1 


Pediatrics 
Psychiatry 

Prevent ve reactant. 
Surger 

Radiology- -Radiobi ology” *t: 


Clinical joint 
appointment 


% y 


e . 
Other Clinical _ 2 
8 


tal Clinical, 


sic Science: 

Anatomy 

Microbiology 

Biochemistry 

Pathol ogy 

Pharmacology 

Physiology - 

Basic science joint 
appointment 

Other basic science 


tal Basic Scignce 


her: 

No department 

Other 

(not classified abou) 


tal Other 


La oa 7 
Stess than 1 percent response. 


4 


sac. 


a 


— MO Ae PD 


Assistant 
«professor 


‘eh aN an 


Other | 


wo i 
so COLO #® a —O 0 #0— 2#0QUW 


— 


o ao -qooooed. 


. No 
None response | 

0 0 

0 0 

0 .0 

0 0 

0 0 

0 0 

ie} 0 

0: 0 

.0. 0 

0 0 
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ere! TABLE 3.2 
S74 3 4 ‘ 
TRAINING AND PRESENT POSITION OF ‘AGMESSION ‘COMMITTEE MEMBERS : 
ze : (Participants, group) . ocak 
= 7 — ~ — ra - : nt 
% of 91 schools citing’ proportion of admission committee 
*Traiping and present” position members in éach training category . _ . ; 
eat. na ot . m. Over — 
None 1-108 11-20% 21-30% .31-40% 41-50% 50% | 
M.D. ¢linicians(nonpsychiatrist) 10 1 oe 35 0 “2 . a 4%, 
M.D. basic science teachers 42 8 30 9° 7 2 2 
Psychiatrists _ 52 n 734. 2 1 0 0 
M.D. administrative officers : j ; 

(deans, directors of admissions, etc.) 3 6 36 0ti“‘<‘é«‘~C*SS 9 Ae 1 
Non-M.D. basic science teachers - . _, 30 4 37 nN 9 7 2 
Psychologists 94 4 2 - 0 o.. --. 0 0. 
Non-M.D. administrative officers a Lo 

(deans, directors of admissions, etc.) 59 9 22 - 4 3, 1 2 
Premedical advisers * of 0 7. 2 2° @: 0 . 0 
Others “91s ya Be 6 0 : 0 0 0 

a —t- a ; 
Source: Gee and Cowles, 1957, p. 131. / : <e ' 
: ae : 
o 4 
' 3 
aa TABLE 3.3; ° 
. » r s . . 
a . 
Bize of Admissions Committees as. Related to Number of Applications 
Processed for 1956 Class ¢ 
roe a ee ___Mumbér of Applications Processed _. 
ON . ofo . ; : : re 
Members on ‘, 250 or 251- Over 
Committee hain less 1000 1000 Total. 
a ae & 
"XJ (18) (45) (28) (91) 
2-3 (5) o°' * 2 a, 6 
a ‘ ; Se 
45 (28) 6 13 - iz. 31 
1 (23) 9 | 12 ye . 25 
; ” — > 
8-9 GQ) 7 - ad i 
10-11 | (a4). 2 9 hae a? ye 15 
12 oy more (19) 0 6 5 ‘1 
’ ‘% . - 4 e 
Total (92) . . 20 . kg 31 e* ; 
° 8 s 
‘Source’, tee fre towles, 3957, p. 200. : 
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Be ee : 7 TABLE 3.4 os 
= 7 “ 4 us Z eo BS, : ' 
= ‘ , . 


” MEMBERSHIP ROTATION OF 


_ ABM]SSJONS COMMITTEES a aa 
a . ? _ gf |). (Partictpants group) ee a - 7 te 
i ru ee ee . ~ go es 
x ee & of 36 : 
‘Venbership ‘rotation ae schools* oi \ 
: Mt Teast sone members are. replaced , 
‘each year : 47 an . ' : 
at At, least some nenbers’ are replaced every poe ® : 
sa ,two years . ; 6 ® 
‘ F At, least some member's are replacei every - : : , oe ne 
+ ". ~ three years 14 fos ia <3 y 
4 ~% At ldast some members arp “peptacta every nang RS “Moe 
. eer four years °. t 6 . ; e 
ae : a Rate {s done at the discretton\ér. ‘ ; 
: : : ‘an’ administrative officer “77 8 ’ 
ae . Mo regular replacement plan. |” ie : = BS 
; Other “ : dt . ; 
: *0f the 91 participants, this 46. per cert, age j 
: ,Stated that the admissions. tommitgee at their . + bs ; 
- ta “school .chartged by some rBtation plan. a a 
« ect t z a . : a ‘ . “oe . ? 
ae ‘ cd ‘ 1 a ae ar ” %. s ; : 
Source: Gee and Cowles, 1957, p. 200. ge 2 Se 8 8 - 4 P : 
r ’ . ° : . Pas . : . ‘ e 
7 : , \ ai 
. ‘ 7s , TABLE 3.5%, 
1 id Fi " . v i. ° a : 
; DISTRIBUTION OF WORK ACCORDING TO ADMINISTRATIVE POSITION 
o : _ (Participants group) - : © 
ery een ee eee See ee . 
F ——oOO SES SOE Se ee EESSS-_—eeEeEeEeEo—————eaaaaamooooooT™TEEE 
: . tof 91 par rticipants citing praportion of time ‘Spent ; 
Administrative. : in vartous areas of activity ; wr of partici- 
position of ee see mend : ‘ ‘Vpants in each 
participant — 3 j . No administrative 
7 1 None 1-202 21-40% 41-602 61-80% 81-) 100% ~=response, © position 
> . 2S a ee al eo, ; 
_' Work devoted to teaching . ~ ‘a e 
Dean or president’ 9 19 “ 0 0 0 “0 29 ; 
Other deans 5 21 19 2 1- ‘0 , ‘0 48 , 
Other positions 0 2 13 7 rn | 0 0 23.., : 
All participants 44 42 33 9 2 0 ~ 18 $00. 7 
. . Work devoted to administration : ‘te 
Dean or president 0 0 0 ] d 0 29°. 
Other deans 0 Jd 13 7 5 12 O° 48 : 
Other positions 1 8 10 3 ] 0 0 23.2. °° 7 
# All participants - ca 9 23 - 2t 13 33 ov. 100 '- . 
See * : . Work devoted.to patient care 
Zz Dean or president 25 3 O°¢ o 0 Oo. ] 29 
¢ Other deans. 33 Hs: 2: i} 0 0 ] 48 ° 
Other positions 14 6 1 21 1 0 0. 230°C 
All participants 72 20 * 3 2 ] 0 2 100. 4 
. Work devoted to research : 
Dean or president 24 a) 1 0 - 0 ] : 29 : 
Other deans V7 21 9. 0 Oo. 0 “4 aa 48 be 
Other positions ‘ 4 6 l- 1 ] 0 0 23 dhs 
All participants . 45 “ 30 21 1 1 0 2 100 27 
. : Work devoted to other activities . * ven 
1,0r president _ 27 1 0 Q i) 0 1 29 a 
. a her deans "44 2. Ve cp 0 0 0 é ] 48 
+ Other positions 23°: 0 & 0 0 0 0 23 ‘ 
i AT] participants » 94 3 1 0 * 0. 0 2 100 
1 ‘ . yA - 
“Source: Oarley, 1957, p. 183, F a 5, % 4 L 
* ~ o ys . Z 
nyt . ; " ~ we eC , 
- . 
a a, na % ‘ 
a : P 4 ‘ 
. ‘ ; , 


ae 432 " 
) \ ; a - oe 
eo & eG " TABLE 3.6 
oa oe _ ADMISSIONS COMMITTEE OPERATION 
. a % _ How does your admissions committee perform its work? | 
' Meets as a group on all applicants a. : ; e 4a Wes 
co oe | Meets as a group on most cases + “ s a2 
: Meets as a group on most difficult cases 8 
.. & e - . i . No response - . * “4 
. ss $ a ue ; 
és, cal a4 | 0 


’ Source: G6e and Cowles,: 1957, pe 200. 
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TABLE 3.7 7 
: “METHODS FOR DECIDING WHECH APPLI - 
as... CANTS ARE. INTERVIEWED . 


“S (Participa ts group; multiple response) 


be , ¢ #5 _ ‘Wethod for cae interviewee . ' $ of 91 
Pe ar 7 7 : ie pagticipants:: or) 
: Meena e —_—. ee 
All of the most promising applicants os 
are interviewed routinely 74 


On'ly candidates who present special 
problems but who are otherwise being 


- seriously. considered for admission a . 
‘are interviewed , 6 
All “candidates who request interviews : 
are interviewed ’ , 44 
_ Only candidates* who request interviews _ : 
are interviewed 20 


.Every candidate who eventually is’ offered a” ; 
place’ in the entering class is interviewed | ‘ 60 
“Participants who did not check any of ‘ 


, ee - the above, methods : . 2 
“Other a “43 
a ee 
t L j Ph ae . a me Py ¢ 
eae : ‘ z Ck / > 
Source: Gee and. comes, 1957, p. 134. |, (8 oon 
45, 


‘aa a 


oe .. - TABLE 3.8 re 


_ COMMENTS ON COMMITTEE'S ROLE IN’ DEVELOPING 
He _ ADMISSIONS POLICY AND PROCEDURE ; si 


(Participants group) | fee, as { 
: Pee ) 


x 


tof 91 


‘ Committee's role ae ee “schools* 
Committee. ‘Yecommends policy to execu- 
Aon, tive faculty. ‘ 21 
- 7 Committee ‘makes’. policy = 13 
. Committee recommends policy to dean 12 
; Committee makés* ‘a periodic review of. 
policy 11, 
. Committee recommends policy to admin- 
istration py : ee re 
Committee recomménds to dean; dean’. an aia : 
«recommends to executive Faculty or . Ne a 
ee to administration . 8 
ae ee Other method used to make policy an 
© ee Irrelevant. comment . #4 3 ee. 
ce No comment; si ok, 1 


40f 91 participants, 100 per cent claimed that ~ 
the admissions committee at their. school assisted 
a admissions ‘policy: ‘and: ‘procedure. 


or . 
: , ay 
‘ x . an ii 
: 4 
- vel 
‘ 
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~~. Source: Gee and Cowles, 1957, D. 200, +: 
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1973). The eeseicwannies for the Fourth Teaching Institute only asked. 
several very broad questions concerning their manner of*operation.and 
involvement «in policy making jssues (Tables 3.6-3.8). . This ‘absérice pf 
more elaborate data may indicate: that the workload of admissions commit- 
ees was not considered a serious problem at this time. 


" sixty-three percent of the respondents fidfeated that a 5 special a 
effort was jade. to orient or train new members of their ‘admissions com- - * 
mittees. -Of these, 72 percent utilized,the method of “briefing” the new. 
~,member by experienced members or an adininistrative officer. Members of 
e, the committee almost always made an. effort to review the results of their 
. previous decisions, i.e. data. onz8ttidents me were’-having special ie 
Ficulty or who had dropped out. ee 


’ Perhaps. most.. “ptemstiie is the data the Institute did not, include. 
We are un in formed: as to the age, sex and race of ‘admissions committee .. 
members of the 1950's, therefore leaving unchallenged the assumption 
hat they were almost invariably white, middle-aged. males. This is. in” ; 


the demographic comps ition: ‘of "admissions commi ttees Pera a ety 
debate issue. Sign, Cea 


age _ = 3. : 1960's a : -? ; 

= From the Fourth y Teaching iwetitute ip to the late, 1960's,’ there 
exists an amazing; yoid. of literature congerning the ‘admissions, committees. 
Much ify ea was ‘being given to other ‘aspects of the admi ss ions : process, °. 


especia] ly. concerning: the range of criteria used in selecting students, 
but thefe was an almost total lack of examination of the group of. indi - - 
‘viduals who were responsible for selecting dur future: physicians. tAs*: 
noted earlier, Funkenstein (1970) wrote of the deplorable. ladk ofself-. 
examination which seemed to exist among these highly influential conmit- 7” *. . 
tees.. The 1960's had brought on a vast array of social}: ‘changes: which " 
carried strong ‘implications for the nation's .medical ° "schools.* “The process 
of selecting medical students as it related to meeting: ‘the rapidly 

evolving needs of society was sharply scrutinized... Still, ‘as far-as .can 
be iscerned from the literature of this period, no: systematic appraisal 
was be'ing made in the 1960's to‘ determine whether: or not admissions ‘Com- 

. _mittees were: in fact changing with the” “Fimes . a “g odd eo 

ii 1969, the AAMC's Office of: “nority. AFFairs’ began sieiehint the 

booklet Minorit ‘Student Opportunities in tha! United States Mediéal Schools 
: (AAMC. (DSP), 1975) which contatns Information on the structure or éach school's 
admissions. committee as it relates to selecting minority applicants. In : 
‘the ; late | 1960's a numbeP of schools had begun forming special subconmit- 
tees. Of their, admissions.committee to deal with the "nontraditional" 
-ngture of many minority applications. Members of thes Subcommittees, 

: were usually non-white themselves, and_were cognizant of the ‘special ~ 

sy ect involved in arrears the ‘applications of minority SEMCENNS 
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Also in 1969, Frank Stritter’ S survey of ‘medical school admbss ions\. 


and’: student fairs: officers brought out the increasing number of studerits 
vo ating in admissions comnittées.' Of those ‘responding (143 out of 


175), 30.8. percent reported that, students did participate in admissions, 42.6 
percent Said thev did not but should, and 21.1 percent. said students. id, 

not and should not. This is an interesting change from the Fourth we 
TeachingsInstitute' s survey which did not even ask’ this question, appar . wide 
ently assuming that few if any Sengolls had students on their adn Es ions ae 


- ” * eommitte. . . 


A 


t ‘t 


7, | 1970's | .  # 


- 


_ The adaptation - of the compos ition and Hace nedrcal school 6 Nl a 
admissions committees may appear amazingly slow-to some observers, but 
change does come aftér much $hought and deliberation. General ly conser- 
vative by'nature, several years may sometimes’ elapse between thie -espousal 
of goals.set by the nation and its ‘instjtutions, and ‘the implementation 


sof ‘These, goals into the functioning of an’ admissions committee. 


‘Thus far the literature: of the 1970's fas *deijori strated some evidence : 


of an investigation into the issues raised from the late- 1960's on, as . oar 


they relate’ to admissions’ committees. Funkenstein (1970) not only 


‘ ‘criticized the curfent: structure and operation of these committees, but 
‘also made-some specifio and detailed proposals for their improvement. 


“| Foremost among his.-suggestions ‘is-that "it is no. longer. possible to use oe 


place the selection of students for special pregrams on: the basis of the 


Qo. . 
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ae wot overall” fauukty. academic apna di Sdn istration, 


2) they would allow-a continued, fa) aie considerat 


carefully s¢crytinized by the entire” blabla In. order ‘to els unrea- ° 
sonable 


Sucre by which each highly qualified student's credentials-are 


Ae 


=, Students, alumi, minority groups, womep, house officers, and. young 


wet 


faculty jembers’ , . . The admission committee would consist of «wo 


- categories of. thembe Ps : (a) General, and (b) The Chairmen of Subcommittees 
#4 for selecting students for the various. programs“ ¢p.. 504) oe? : 


ahs 
-, 5 i 

Lae 

oye 


These. subcoimi ttees woutd serve a twofold purpose: 1) "they wuld” n 


“most ‘appropriate eriteria: ‘and techniques for that peas program; and 
on of each applicant, 

a process no longer -possible current jae cs due to 
- the’ ‘increasing number of appt Mants’ (p. 506): . pik 

_ Many, of these suggestions were in fact imp leménted. at Harvard with. 
much success. -In- August of 1974 an Admissions Review Committee was 
appointed at Harvard (Cheever, et al”, 1975) and over the course of the “ 
following year they carefully assessed the admissions process ide 


-a Close examination. ‘of thé admissions subcommittees. Recommendations for 
" changes and abegratis were ‘made , but on the whole the system: ‘spemed. to 


“ “8 
_ 48 ; ie 
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‘withthe ddta presented in the 1957 AAMC study, (Table 3 


“fromthe clinical science faculty and. the 1957 study. sh wed 51 


': percent: of admissions committee mentbers ;.. cand” department chairmen: 


fe. ee 


be working. It is, however, difficult to assess how applicable this. 
structure might be at schools othem than Harvard. Nevertheless, it does 


‘demonstrate how some creative Reorganization can revitalize the functton- ~¢ 


ing of an admissions committee. -_ » 


In 1972, Oetgen and Pepper apne ‘ona comprehensive survey con- 


‘ducted the previous year of all U.S. medical school pdm ssions “Officers. 
"A questionnaire designed.to elicit information about 


admissions conmittee 
members and the functioning of the committees: was’ completed and returned 
by a8 (59 percent) of the 124 institutions polled. (Canada was included) . 


Unlike the “Fourth: Teaching Institute survey, deta and: Per per did 
collect data on the demographic characteristics of 


years ,. ‘the modal age being 42 (mean 41.5). Women comprised 8 percent: of 


the conmittee members (63 percent of women committee members were réported 


to hold the M.D, degree: and 25. percent held the Ph.D..degree). By race 
and: ethnic group,” the: committee members were. distributed as follows: 


,. €aucasian, 83 percent; Black, 5 percent; Oriental,’ 4 ‘percent; Puerto ee 
~* Rican, 0.7 percent; Me xi can-American,. 0.4 percent. Theye were. no reportéd..: 


American-Indian committee members: Slightly. over half (55 percent) of . 
re sponding: $chools indicatéd’ that’ there is at: least, one pact! mjnority 


member on their admissions . commi ttee® (p. 966). : i fe 


Ei ghty-8ight percent of the total sample fia either an’M.D., ‘Ph. Ds; 
or both degrees. The mean, length of time ‘spent as an admi ss iqns commit 
; Fee member was: 3.] years. “i; — j 


"Data on ‘veep ondenite™: teaching avers eepetet or adninis- 
trative positions are presented in Table: 3.9% mparison::of Table 3.9 
a shows many 
Simi tariti s, but there are some differences. 'For examle,.in thé ~ 
present study 52 percent of sampled admissions For oxy members are “ 
erceht” 
in this category; 15 years ago deans. ‘or, their assistant compris d< e 
i3ed 
an additional 20: ‘percent of the cori ttee: s@ats-whilé tpday the deans 
ey a Na Has: dwindled. to: 5 percent and. the department chairmen's 
4 percent of committée members; With respect to the teaching rank of 
committee members, the 1957. study Perens 


professors, In the present st@y 24 perceht of committee. members hold © 


teaching ranks of associate PeOne aor and 25 percent are assistant | . i: , es 


professors. 


> "In 157 there we re very: ‘few or no students | on medial school adini s- 


sions committees. The t survey showed that:over half of the | 
responding, medical | schools" ‘(5€\percent ) now Ane] ude at.-least one Student - 


~ 2 on their’ ‘admni 55 fons committees;) and am over half of these = Percent: of <a 


*Table number “changed. to conform with this literature review. 


sa er 


committee mefhber's. ~It . 
was found that "ages of admissions committee member's ranged from).21 to 67. 


wee 


at 23 percent of COmmGteE we ot 
. members were associate professbrs and 18 percent were assistant: 


: "PERCENTAGE OF 853 ADMISSIONS COMMITTEE MEMBERS BY sPacnne DEPARTMENT AND 
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', Teaching Departnent 
Clinical Science 
Medicine 
Ob/Gyn 
Pediatrics 
_» Psychiatry 


‘Surgery - 
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Radi ology “Nucleag Medicine 


Other Clinical 
Total s 


“Basic Sttence 
Anatomy ° 
Microbiology 
Biochemistry 

, . Pathology 
Jf “Pharmacology 
it * Physiology , 
“Oe. fest Basic Science 


. + Total 
. Other 
. 3 No an Departments 
i lo Answgr ios. 
toa rose nie 4 : 
i y Total 
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- *Less than 1 percent. 
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Source ; , “Oetgen and: Pepper ,. 
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\ ae) TABLE 3.10 - ae 
i 4g . _ TEACHING DEPARTMENT AND ADMINISTRATIVE POSITION OF ADMISSION 
as 4 ea MMITTEE MEMBERS 
. (Committee members grdup) * 
. : rn : e 
% of 534 committee members in each dept. ° 
Y . according to their administrative position - Total 2 ” 
nate Teaching department “ * - ; - ineach . 
Lae Dean or Other. Department None ‘ -teaching we 
president deans * chairman Other given _Sept. 
: Clinical: . i . 
Medicihe 7 # 3 2 3 10 19 
Obstetric3/emebo igi * 7 1. 0 2 3 
Pediatrics * woe 1 * $j 4 
Psychiatry 0 bd -1 2 ‘a 3 7 
“"y Preventive Medicine: * . 1 1 ft 2 4 
Surgery 0. _- ae 2 aah ye 
Radio logy/Radtobiology. | 0... : & * Roe = os 
Clintcal joint appointment On TS. 0 a 1 a eee 
Other clinical * * Sete. By: 
: Total Clinical » 3 2. 4 “ 9 9 27 5] 
* : i Lt a ' © 
* . 8 Basic Science: : a vat ar : 
ey. _ > ‘Anatomy ’ 1 7 2 2 1 as | a 
4 reg Microbiology 0. / ot 2 * 2 rf 4 > 
or i Biochemistry *°. ~ id 2 ff 3: *. 4 8 i 
"Pathology | 1C 4 1 0 4 6 
Pharmacology. . * il 1 0 2 4 
_ Physiology i. ao. at OW re age & es 2 5 
" Basig.science joint 7 ; * 
: appointment 0 * 8 - L? 2 
ie Other“ basic: science 0 0 1 . ] ~ 
ic. 3 5 n- 2 2] 42 3 
No’ Debartnent, nn nr > 0 6" 
. ' Other(nat, classified above) ° 0 * 0 1 
Total Other = - om 2. * 0,;. 7° 
Jotal % 2 each past tion Pg ee a 2078s NG 49 1000. 
F : : . a ‘ th: 
‘ . 
a 7 i - , { 
. . ¢. ; - 
on ‘ . o? : 
Sourte: Darley, 1957, PNI83. ‘ Sk : — ‘ “oe 
. . or] : 
l ny ; s <7 Z 
| , a) 
a * “%y e 
: Fo ae : 
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_gommittee members. Soke ; ae 
y * 7 4 . : ‘ 7 i 28 : ; ‘ eoae 
“ss""Tn contrast to the increased representation of medical students, 

the consumer community has virtually no representati‘gn ‘oh medical school 
i ‘*" admissions committees. Only two schools reported that..their committees ~ 
include representatives recognized as 'nonmedical, nonprofessionalZ | 


aia -Two other schools reported plans to appoint such members" 
~~ (p. 967). ie. a ; 


total respondents), student bodtes have soms_yptce inthe selection ét 


= 


fe -i In addition to the comprehensive natiogat-analyses of. admissions i? 
+ comnfttees reported above, several eh oat medical Schools have also’ 
published reports. in recent years descrjbing the composition and i 
. “organization of their own admissions committees. _ 
In a‘ brief, .applicant-oriented article, the Dean (DuVal, 1970) of 
the Unjversity:of Arizona's CoTlegé of Medicine reported that their 
- admissions commit&ee consisted of 10 members: 7 faculty and 3 studerits. 
He rma eo (1971) .of Creighton University School of Medicine 
described their committee as consisting of eight members who represented 
ge li medical disciplines ang were equally divided among preclinical 
ahd-@linical disciplines (there were also plans to begin including 
a -students as full members). Committee members met for 4-6 hours per week 
. during peak application period (Octebé¥-February). The Committee was - 
- chaired by an Associate. Professor. of Physiology and Pharmacology ‘who ft 
-.... devoted 10-15 additional}:hours per week checking applicants’ files, 5. Bea. 
wee noting deficiencies ‘and undertaking preliminary screening. Po ea 
Me ee polit daw" 4 i Be teen 8 ee gts née ge THAN 
Seine the: admissions committee of ‘the University of Nebraska College of. ° 
Medicire (Henn and Carver, 1971) consisted of ten. members,’ eight of .whom i 
were faculty. Members were recommended by the Committee on’ Committees ° 
chaired by the Dean of the College of Medicine and were ‘approved by the 
College's Executive Faculty. They consisted of faculty from basic and 
clinical sciences as well as volunteer “faculty active in the school as: 
well as theiy own practice. The Assistant Dean for Student Affairs. - 
served as both member and chairman. .Student members:were chosen by the 
Dean of the College in consultation with the Student Affairs Officer. 
The Committee was.responsiple. to and made all recommendations to the Dean 
gon. Of the College of Medicine fof his approval or disapproval. The 
«=. Committee met weekly for 4-6 hours after the November 1st application 
“ (deadline. | ae 
4 a : , ; ae = 
Morgan “and ‘McKee(.971) reported that the West Virginia University ; 
. School. of Medicine.-had ten faculty members dnd two students on its 4 
admissions committee; which was: chaired by an Associate Professor of oie 
‘Neurologf. At the University of Washington School -of. Medicine (Schwarz; .. * 
1972) the admissions committee consisted of three subcommittaes: . one 
Screening and two interviewing. Each subcommittee was comiggegyof a 
physician from:private practice, a basic. science faculty Tonbei a a yeep. gats 
_ member of the fulltime clinical faculty, a Student, and the admissions: aa 
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- Committee, 


concerning these committees, but there is no comparable data for the 


-40- yg 


a 


officer: Usually there: was. also another faculty member from either the 
basic or clinical sciences. a a committee reviewed the com- : 
pleted applications and decided who would be interviewed. The inters” 
viewing committee s then took over. and made the final dec sion ee 


In 1973, the University of Oklahoma Collége. of ‘Medicine included 


ne representatives of the Oklahoma Academy of Family Physicians and the | | : 


State Medical Association on Its: admissions ‘committee. In addition, — , 


there were part-time and, full-time. faculty as well as nine fourth-year 


medical students chosen: by the student body. . Each applicant was inter- 
viewed by three committee members, one of whom was a Student. The -Review 
dasisting of the most experienced members, did not interview 
but reviewed each aptica folder and voted on it. The Chairman of - 
this committee would then report’ the vote to the whole board who would .. 
Make the final decision. oe - 
The Committee. oni‘ ‘Adit ss ions at Jefferson is appointed annually by the 
Committee ‘on Committees! of the College. There presently are 26 members | * 4 
of the Committee:.'Six from the pre-clinical faculty, 14 from the-¢lini- = 09” 
cal faculty, tho. Who hold appointments in both. the clinical and pré- . Coo 
Clinicalfaculty and the Registrar‘. “Threestudents with full voting aa 
privileges. also are appointed. Nee tingsiand interviews for the follow- 


oe ping year's, ‘elass begin in July and end in May, with the Committee meeting 
. every Wednesday from 12:30 to 2:30 p.m. (Conly, 1975). 
: , os % te 


Summar 


While the admissions committee is at the hub of activity in the .< 
admissions process and:carries much inflyence, the- changing.. patterns of 
its operation and membership over the past twenty years is-difficult to Q 
assess becaus€:of a lack of literature dealing with it.. The Fourth 7 & 
Teaching Institute (Gee and Cowles, 1957) produced much valuable data - - 


1960's and a discouragingly smal eanome for the*1970' Ss. oe , 


: Reports from: ‘indivtdual. nediéal schools, as well as 44,1969 survey 
(Stritter), show. ‘that: the, student activist days of the ities had an | 


- impact on the admissions: Committee by. their. “inclusion @f students, often ©” 


as full voting:members,: In addition, AAMC' fi Minorit 
in the United States Medical Schools "(AAMC ( D » first ‘pu 

», and Qetgen and Pepper"s survey (1972), demons” ate that many . er 
admissions committees. have been making a serious effort to admit more . ~ ” 
minority students by sabes special ee ati$-Apcluding More 


ent 0 ortunities . 


minority members . pees 


Thus, there’ is | ‘Some . indication in the literature that 1 dfcal 4 
school _adni setons commit tees are _ attempting to reorgant. emselves 


bet, 4 
wali, toad 
wee 


oo at 
a: : & “and, institutional goals of. increasing A 
ae representat ton..of 'minoriti “and - ‘women in medical schools. The . 
" Viterature is’ “sparse howe ver , and iar setouec part prec ceived’ notions 


“comittees function. have been Tess than J 
’ reported. 


’ 


soe 


_ 2 rs ; v8 ¥ feo aS. a 

, . = “cuaptER I or. eee 
: = ° ve fa me 4: 
af, o 7 . SELECTION FACTORS ni, gy . 

Oe Pd. ee THEIR. PREDICTIVE. vacqorry gg Eg es 

u : . ~ * : eae is bg 2 . ‘ | : a 7 

ee ao ae gat 

a & " , 


: ok 
~ Even in 1956" ‘it was trite to say. "that othe: sdidction ; process is, 
essentially a problem of prediction (McConne}1, “WO52).- While. admissiok’s - 
; continues to be a problem of predictiton; ee being predicted | « 
have changed: ‘during the last two decades, In thé 1950's and early. 
1960's the iagor concern of admissions ° “committees was to select appli- 
cants who would’ successfully complete. their medical training and go on 
to be "good" physicians. The concern was to ‘reduce the higher rate’s of 
attrition from medical school which were characteristic of the time. 
By increasing the accuracy of predicting which students. would and would 
not complete medical school, the production of physicians could.be - 
increased while the financial cost to the institutions and the ‘psycho- 
“logical cost to the students could, at the same time ,- be decreased’ . 
(Johnson and Hutchins, 1966). a. < es . 


“While the attempt to keep. attrition doin ot inues to be ‘ane _ 
important element in the selection process, a sayy enlarged applicant, 
pool from which to select potential medical st ents, the improved: . Po 
academic credentials of today's applicants, atid’fréessures for the. _ 
production of physicians to fill. socigtal needs have combined to a. 7 
emphasize medical school achievement as the major criteriof’ being’. 
predicted by the admissions process. Furthermore, there Has always | 
existed an awareness that there is not a one -to-Mfie relationship “between 
maven school ey eee as a physician. . ' 
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: The criteriof Problem ° ae ae 
. 7 & ge oe 
Actually, one of the two major changes evidenced in the literature 
concerning selection variables over thespast twenty years has Seen the | 
change. in emphasis on attempting to predict the immedi ate. objective. of 
medical school achievement to predieting the long-term ‘object ive of 
physician performance. An excellent survey and evaluation of research 
on the measurement of physician performance by Barro (1973) points up . 
the variety of ways to measure physician performance. The probleth, 
then, is which of all these criteria should the admissions process ! Z 
attempt to predict? Gottheil and Michael (1957) in a’review o€* the, 2 
» Variables used in medical School admissions were neither the - first nor - 
the tast to point out that: "se 
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a ae i. 2 Presurably the seal of ea educatin’: is 
mol 4 eS to produce ‘good" doctors’ of méditine. What” coh = : 
“i, °° * §titutes the good doctor, however; and how'ta, > =” ae 
“evaluate the. constituerit. factors remains the most a er ae, 
oe ee perpiexing:problem in the: field. This: que $t:ion e 6g 4 Ss eae 
te _ -. .; vepresents, fhe fundamental ; probe baci to, oY oe BEE Ga 
Hs a ae, others in. sélection. fp. 147) ea co cnrs 
At the st ime when attrition was. a: ‘gel ous coheehd ities * "ogigat,- ete 
to. emphasize that. in, order to becoie-a seats studer't must first — 
ne Sa graduate: from medical school. Thus; thé admissions process’ was:.seen, aS i ak 
‘ -an attempt to Predict*two types of. performance , one’ a “preface, tq the.. : 
_ 6ther: | perford as a medical. ‘Student. and pérformance as ¢a. physicyan, 
To: ‘complicate ‘mattérs ,” as McConned 1957); pointed /out, performance An? vy 
“Neither: role: is unitary, since medical students fiust study*both :the’ a. 
. basic. and the, clinical sciences’ and sincé .phys{¢ians do many things, a) 
“O.ge practice’ “general or specialty’ medicine, teach, lacy cae has etc, . 


Pw. 


With today’ s larger and ° more. ‘qualified app tii vant pool, ‘it. has. been: o : 
possible to concentrate on “selecting persons;. not primarily for medical - : 
- » |.» School survival, but more for the ‘practice of medicine. | This. new focus ~ 
"* 4+ «has gone hand in hand with the-other major change seensin medical’ °° 2 ~ 
: 2 “ schgot: admissions over the past: twenty years, namely the ‘attempt to 7 
r. ~” seTect persons - for: the medical profession ‘yho Will. serve, certain, =". |. 
". .:. societal needs. ‘These’ needs have.’ been: defined to include’ (a) greater: 2 
, * + " access to'medical careers for.groups héretofore underrepresented in - 
i the profession, particularly WOT, minorities and persons from dis-- 7b 
a advantaged backgrounds, and (6}a ashore balanced distribution. of, : 
x ° physician manpower by special tigs., and practice “locations. Henig . (1976a), 
7s’ + however, observes rather colloquially that "“naldistribution is.‘the- , 
profession ' s',current rallying: cry so individuals who. seem, likely to '> : 
‘ cHoose ‘small towns. and primary ‘ca® are hot’ items* on today's. thedical “s, 
education. marketplace. But . which types- -will medital. schools be Glamor- _ 
ing to admit next year?" Nevertheless, societal ‘requirements can be * 
"viewed as one step toward reducing the ambiguity” in ‘the: de firki tign of .a: 
"good" physician which has ‘plagued eonecienbieus persons. ‘involved in. the . 
actual selection of daca students. og e ie 
The? intention of ‘this discussién -has been’ to undertine the. ‘impore mS 
tance of defining.the criteria,one wishes to preditt; in order- to be x 
able to search for variables: -whi ch, ag ‘successfully. predict ythem. - A x 
continuing theme in, the literature been the appeal: for such defini-“ »# 
tion. In 1956 Darley: (1957) scolded participants gf AAMC*s Fourth © - , 
Teaching Institute, after examining their responses: to the Institute” Sg 
survey of admission cniteria,, "the variables’ which are of. coacern to ~ 
you’, regardless of the degree gf .confidence pidced in #hem; are yari- 
; . ables which,:so far as 1 could*tell, -do not. shebang the profession +“ 
of medicine from any. -othgr ‘gman creat ive activity” (Ps ee - s 
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ots ~ gchodTs! then: extant 


Senna yer ts survey of the 103 U.S. and. Canadian medical 
emonstrated that not much ‘headway had been made in 
spect fying”the “ ‘desirabl@gcharacteristics of a physician (Mlott' and 
“Schachte?’ 19729... Oty 73 schools responded to the survéy andy. ‘of -those, 
“ 40:@8sponded, to. the: question regarding the desipble characteristics of 


~ a phySieian. . Sixdf, th®non-responding: &chools "made. “statements 'to the 
ye effect that- the dastrabTe attributes. pfa physician’ are ““highly . 


& 


< Variable. ‘and hobddy has an answer.*.":-he-number of attributes suggested 


aoe 


“bye the res fee pe ay nes From te to 18, with a mean of 3 
, aber iputes | (p 32 


. Un toreiate lyn: ‘the... authors do. not Hieeent their. results in full.. 
“They HPeport that "data tabulatigh. revealed thaty.unqtieSt ionable jntegrity: 


"sis the. characteristic deemed nfost’: {important | in ‘@ fhysi cian by 12 of the 


os : “\ oe = ms . 
s © : « ' 
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6 (25. 0%) rated a continuing desire for learning: and: 


responding medical schools (30: 0%). Following this: 11 schoolss«(27.5%) 
‘emphasized motivation to follow a career in medidtje, and 10 schools 

se 1f education 

, tnportant.. Intedligence above average was alsoxetted by'10: schools’: ee 
(25.0%), while 9' schools (22.5%) emphasized compassion, warmth, and- 
“interest in others’ welfare. Slightly Jess frequently, characteristics - 
such as maturity, emotional stability, and honesty (6 schools, or 15 0%) 
were cited.. A total of 65 desirable attributes were listed by the 
“médical schools answering this cael (pp. 320- 321). 


“4n ‘a ist of eight. recommendations regarding admi ssiOAS" nade" to the. 


; nedicaT schoo}s.by/ an ad hoc comitétee of the AAMC's Coun'ci}; of Deans. . is: 


(Green ‘and Johnson’, 1972), the first listed is that of "a better _ 
de Finj tion of ‘admissions objectives” (p. 975). , 


Jarecky (1974) says "the problem, whether selection is focused ‘ ‘on 
minorities, puraliyouth , “or applicants whose characteristics may appeqr 
consonant with the eventual ‘practice | Seto ders care, psychiatry, or 
surgery, is essentially the same;-- how to define those crucial ; 
elements of behavior,and identi fy. those values that tend to predict 
desirable phys i<j an characteristics" (p..;13). Bass 


> 


_ thé criterion of medical school performance. A few studies whigh focus” 
on. physician performance as a criterion are considered, principally in 


+ +cénnection with ‘cognitive admission factors. The literature ‘review by 


-Bayro considers some non-cognitive characteristics related to physician 
; pe'rformance in the. section on interpersonal process approaches. But, 
-as “she points out "the buik of the physician pey formance literature 
focuses of the technical as opposed to the, interpersonal processes. 

reover, within the technical .domain there tends-ta be heavy chest 
on the cognitive ‘aspects -of: performance" *(p .- 710A) 
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“This chapter will concutnate eae on studies ‘concerned’ with: 
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Domains of Student. Characteristics aitd Their Measures 


oe ace 


Pes "Th. spite of the aa onplexity and imprecision of: the criterta: which 7 *E “¢ 
:are.betng predicted, ‘ther& are certain.pieces of information ‘about 
.ge@pplicants which have beer” found. to make, the admissions. process & 
ee ficantly better-than-chance - ‘procedure. That. information .is usually .: 
Gl 1assi fied‘ into two types: one concerning the, intellectual or cognitive: 
‘characteristics of an applicant and the other concerning non-cogritive 
““ characteristics. Cognitive characteristics refer to both aptitude | for .. 
ww  .° intellectual ‘work and the achievement of certain levels -bf cscs 

8 me Non comtitive: characteristics; as the term ‘implies, include everythiag - 

other than intellectual traits and. usually refer to biographic/ ** 

demographic, personality and career’ ‘motivation/ interest factors. “These, 

then, are the major domains into:which information about applicants are 
usually classi fied in the admissions Mterature. ) 

For ash applicant, information. on. their differing characteristics 

‘is obtained from a variety of sources or measures, the major classifi- 

' cations of’ which are: cognitive test scores, college transcripts, - 
letters of recommendation, application forms, ihterviews and psycho- 
logical tests. Figure 1 shows the applicant characteristics Homa. a en 

fe. % for which the different sources provide data. 6 


‘ 
. “Each of the. major domains can and. usual ly are broken. down into more 
tspecific categories, categories often operationally defined in terms 
“of the instruments used to measure them. For example, while intellec- 
_¢ tual aptitude is often treated as a unitary concept, it is equally as 
fo. often treated in terms of two subcategories, verbal aptitude and 
. ° quantitative aptitude. In comparison, the subcategories of personality 
character#stics, defined both conceptually and operationally, Sdéem, 
after a-reading of the l#terature, to be ost infinite. In a similar. 
manner, the.sources of information on a cant characteristics can 
and usually are specified with greater precision. Interviews can be 
admissions or psychiatric, group or individual,.etc.; transcripts include 
- grades, credit hours completed, college attended, etc.;. recommend@pions 
sae can be written by faculty., premedical advisors, employers, peers, etc. 


While the foregoing provides some structure for considering the 
types and sources of information used or recommended for use in the | 
,admissions process, it is not as Straightforward as it might seem at 
first glance. Not only does a single source of information reflect 

. characteristics from more than a singlé domain,. but re importantly, 
characteristics from different domains typically are interrelated. For 
example, demographic characteristics such as sex and racial identity 
are related to tareer interests; while health and biographic factors 
are related to achievement. Thus, McDermott et al. 11973) demonstrated 
a rekationship between academic achievement and career motivation/ 
‘interest, In {heir study, students with the lowest GPA's chose medicine 
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FIGURE 4.1 


y “ a - Sources of Data on Applicant Characteristics 
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purely to academic factors. 
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generat “information knaw ledge. <a a 


THE MEDICAL COLLEGE ADMISSION TEST (MCAT) 


‘for the seaamatie corivation® ‘of financial success and status, hile ‘the 
more academically success ful students ‘chose medicine because of social 
~ idealism, Scientific interest and ifterest in people. Recent major 


Changes in the criteria recommended for the admission of non-traditional | f 
ap ien ‘and the weights assigned to those criteria were in response. ' 


een’ charactertstics from the broad cognitive and non-cognitive . 

doWjins, particularly ‘of the effect, of socioeconomic background on , 
academic achievement (Elliott, 1924; :BiCosta, 1974). These relation 
‘ships Siar be’ discussed in greatercdetatl Taree in this. chapter. 


efforts to remind admissions persons of the interrelatiofships 
ye 


: ‘7 se To md 
Most oF the emphasis i in eoiecuion until - recently has focused on 
characteristics in the cognitive domain, both on intellectual’ aptitude 
and achievement. AS was mentioned earlier, this was a result of the 
b that part of medical student attrition’ which is due .’ 
A 6 
: Results ‘from the survey conducted in connection with AAMC's Fourth 
Teaching: Institute reported by-Glaser (1957) and Ceithaml (1957) show 
that, after “character and integrity," "intellectual characteristics." 
and "academic achievement" were considered to be’ the most important: oF: 
fourteen applicant characteristics, the others ‘of which were all non-: . 
cognitive. . These were, also, the two characteristics which admission§ 
committee members and institute cpaeie patie: felt most confident in . / 


v4 
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The marr’ sources of information on student? initellectiat aptitudes * 


“Scand achievements have been the Medical College Admission Test (MCAT) and 


undergraduate or premedical grades. Because both proWide quantitative 
indices of a student's abilities and knowledge, they may have been 

aed agli eti eden ok tbe the greater confidencey of admission commit- 
tees in evauating intellectual characteristics. The MCAT is actually 
four separate tests, two of.which were designed to measure aptitude and 
the other two to measure achievement (Sanazaro and Hutchins, 1963). 

The two aptitude subsections of MCAT assess verbal and quantitative 
aptitude ; while the two achievement\ subsections assess Science and 


e 


- Because submission of stores on the Medical College Admission Test 

)} bas been required of applicants by virtually all medical schools 
in the U.S., to the almost complete exclusion of any other objective test 
of cognitive ability or achievement, a major part of the literature 


aan a ra 


* concerned ‘with ‘medical rennet eens ‘¥etuses” ‘on. ‘the NCAT: its 
ee Preece validity and its relationship to other variables. 


. saat * : . s . 
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" ae, ' 
, Many of these studies are corretatiunal in nature, using attrition, <4 
nedsea school grades, faculty ratings,,-seores . on the National Board of 
Medical Examiners test, internship supervisors' Rabi ngs » etc:, as the. _ 
criteria ‘being predicted by scores on-the MCAT. gn the late 950! Sand - ” 


early 1960's, various researchers, after obtainit ‘low correlations 
between MCAT scores and Various criteria, concluded that the examination - 


had little predictive validity (Richards and Taylor, 1961; Richards 
et al. 1965; Gough et al., 1963)..-In a review of: the test, Wesman 
(1959) stated "the overall: "picture ‘of validity provokés one to. — 


= est?on whether the individual medical schools are (or should. be) : 
wa Sat ts fied with the program" (p. 937): os 
, ge ee : : ove 


This ‘sina x of éoiideanationvor the: MCAT ig counterbalanced by ot: 
articles defending the value. ‘of. thex'‘test:: Fiese articles point out -. 
various reasons for the misleadingly’, Aow'. egrre lations, including that OF 
the admission and graduation of certain. students who seem promising in 
spite of low MCAT scores. It was repeatedly pointed out that the’ 

"restriction of range" of-the MCAT scores of medical students ‘causes the . 
_« correlation coefficients obtained in such studies to be underestimated a 4 
(Gee, 1958; Schumachér, 1960; Sanazaro and Hutchins, 1963). -In other 

‘words, since medical students generally have higher scores than all 

those who apply to medical-school ,’ the range and variability in the : 

distribution of their ‘scores is curtailed. This, in turn, “diminishes 

the size of any correlation which might emerge. However, Sedlacek and 

Hutchins (1966a) empirically demonstrated that, in these correlational 

studies, it was restriction of range of the criterion (of .NBME scores in 

their study)- more: ‘than that ‘of. the predictor (MCAT) whitch ‘was likely” 
_ to underestimate such rélationships. 


_Whether because o¥ or in spite of the dampening effects of such "~~ 

methodological artifacts, the highest correlation. coefficients obtained 

- between MCAT scores .and various criteria have not: generally exceeded the 

.35 to .45 range, with a good many studies obtaining ‘Substantially lower 

coefficients. Furthermore, .as Funkenstein. , (1966b}: ‘pointed. out, in such | og 
correlational] studies it is the squared correlation coefficient which — & 
gives a-clearer indication of a test's predictive ability by giving the: 
percent of’ variance in the criterion explained ‘elner test. Thus, for. 


example, a corre acon of .40 only accounts for Pee of the 
variance. 
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medi 4U-School | or rarer pr gress: 
through medical school: (but: eventual. graduation as” the. re 
‘generally attest to MCAT's” ability. to distinguish dropouts and those - 
with irregular progress from-those with. regular progress. Persons 
dropping out .for academic’ reagons tend’ to have appreciably lower scores . _ 
on the MCAT, »particularly on: the: Quantitative and. Science subtests, than -. 
‘do those dropping out because of: non~academic ’ reasons (AAMC: (DOS), 1961; 
Garfield. and Wolpin, 1961;- Gough ‘and-Hall, 1975a; Johnson and. futciins, 
1966; Sanazaro, 1965). These studies. ‘have also defnon st rated. 2° gener-- 
Pease high MCAT’ scores of those persons’ ‘who drop out -because Gf ‘emotional ge 
='/prob lems, lack of* Tonere sh ‘in the Aistd, and x) ler ngn-sgadenite, aE ess . 
ck Mob eb and: Werner, 19654): ae: se 


: a ‘Studies asin seen 


oe 4 ta Ina study * whieh chaviacterized medical scoot” ‘ey Me gres’ Ros, a” 
, which their respective Students made regular progress toward the M.D. 1 i. 6, 
a feittle, Gee and Novick,’ 1960), it was foun that, at those schools.~. .,.: : 
whe te where was a high: degree of Yegularit » no significant relation - 
Lutter cabe students! academic irreqularittes and MCAT scores existed: 
rests yery.;at. schools where: progress was genera)lly more irregular, = ial 
“sel? aeadent irregularities. were Significantly related to MCAT Scores: “It - i 
may be. that restriction” in ‘the range of academic. irregularity” accounted ‘: 
.. for'the lack of. relationship found for schools whe re most ‘students made; 
reguTar progress. a ; a as Hoo: a ag 


ee 2 mR ae 5 oes 
: . 


Bartlett. (1967) ‘examined the atéeition rate, é as il as class: 
rankings , academic ‘warnings academi ¢: honors, internship appointments, = ° * 
faculty gbno san ments and . jater careers of 49 students admitted to the crs 
niversity.: of Rochester with "low" MCAT Verbal and Science scores. ait 
"Low was defined as two standard errors below.the national mean for’ no 
- ,those subtésts. - When the Tow-scorers were compared to other Rochester “et hs 
“students on the characteristics listed above , the. results showed: no 
+ significant di fferences on ‘any of the characteristics. | vo i. 
* ee. a ae 
“In one: of the few studies which directly examines the prédictive ‘y,. 
validity of the MCAT. for different racial groups, Feitz (1974) obtdined: Ae 
= so SA differences in the scores of (a) promoted students vergus. “iy * 
aters any dropouts and (b) repeaters versus. dropouts. All of these: a 
differences -were obtained both for white students and for black, student s* 
examined as ‘separate groups. 


The atner major study regarding MCAT's ability to predict medical 


" school attritior-or progress for different racial groups is & coopera- 
tive study by the Student National.Medical Association and the AAMC ° 


* 


4 (Johnson, Smith “and Tarnoff, 1975). _The data from that study, on the, 
eo | ‘ ‘ Zl , : 
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’’ Medical School Performance Operationalized a 


Y 


wcat Scores ‘or promoted “aiid not- cbremoted black na white students (which 


are} ‘Yeproduced in-Table 4.1), show- greater differences in MCAT scores 


tween ‘promoted and not-promoted: blacks than between promoted and not-C. 


‘promoted whites: . Probably of eyen more’importance than..the size of these: "| 


.di fferences,,, however, is the «relative level: pfitest performance. ‘ 
Regardléss:.of: rite 5: -d¢ffersnces in MCAT scores in the 500"s':and 600's 


are less relevant im phedicting academic-performance in the bagic science:. 
‘years of medical school than are differences Sin, the 400's. ATthough no 


ready explanation is provided, it is jnterasting: to note, in this table, 
that the: Quantitative, subtest scores of: both: black and white women .who — 
‘are not. promoted are higher thai: those: of the: women:sin the same racial 


= group who: are promoted. 


. “A 


As Grades and Test Scores a 7 | : 
Initially, geeuies of those studies which have examined MCAT Scores 

‘in relation. to various megsures of medi cal-‘$chool achievement! (such as 

grades" class | rank and-NBME scores), seem contradictory, some reporting 


Significant positive relationships’ ‘and some reporting little or no 


relationship. However, it is necessary to dtstinguish among ‘these studies 


on thé basis of the particular: ‘erjiterion measure used, i.e. grade point 
average (GPA) for the first year of medical school, GPA for the first 

two years, GPA for the last two years, ‘GPA for all four years, class rank 
by. year or for all four years, or.scores on two of the four NBME subtests! 
which are taken. at different points along the usual- four-year~progression 
from entrance to seaduadia from medical school. 


Since the first two year of ‘the usual medical school curriculum 
are heavily oriented toward academic study of the basic medical sciences, 
it is logical that the MCAT aptitude and. particularly the’ science , 
achievement subtests should ‘show a greater relationship, to. grades earned 
in the earlier years of medical school. In fact, the original purpose 
of MCAT was simply that of reducing attrition in the basic sciences, of 
making gross discriminations between those who would and would not sur- , - 
vive this™earlier part of the curriculum. Furthermore, it was never 
intended to distinguish amon g different levels of either, premedical or 
‘medical school achievement in skills of specific importance for medicine . 
(Damrin, 1958; Erdmann, 1972; Erdmann et al., 1971; Sedlacek, 1967b). 


a ud 
The results of a study reported by Kelly (1957b) provide evidence for 
the two b aaporcene points: about MCAT already mentioned: (1) that it seems. 


aS 


The’ success ful completion of these ti parts of the NBME is. required by 
many ‘schools: as a promotion criteria. For the 1978-76 academic year, 
only’ one-fourth of the medical schools ea either Part I or II 


optional (AAMC, 197&c ). 


63 © 


se : ms a 5 7 of 


ae as . oe : 7 ol TABLE 4 : 


EANSSCORES ON MEDICAL; COLLEGE “ADMTSSEON 
“RACES SEX, AND ACADEMIC PROGRESS: 


ENTRANTS TO U.S. MEDECAL SCHOOLS... 


1970 


BAY . 
|Prdmotion 
“Success* _ 


erbal . tat opener = 
Ability . Ability . _Infarmatton Science: 


Caucasian (N.='5,800) 7559 -- > 616' ,, 565 ° “666. 
Male a 659s. IZ S64 SBT 
Not promoted * §53° , 605 -» ' 552 « 55S. 

Promoted - ‘ 559 i. oy a: ree 

~ Female 3 * §58 558 eee 

Not promoted . 545 536 rer, 

Promoted _ 559 559 


Black (N = 390) = 447 
Male 445 
‘Not promoted’ - 420 
Promoted | ; : 4B2 - 
Female . 497 
. Not promoted AS _ 
. Promoted “ 


448 
448 a a 

41 5 
458 


x a 


“*Defined as immediate promotion of néw entrants from first-year. 
to second-year class. Data are given only for those subjects for a” 
whom complete information was available and thus do not reflect ali‘: # 
of the Caucasian and black American new entrants. . a 2 


Lang 


Sgurce: Johnson y/Smi th and Tarnoff, 1975, p.. 755. 
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_ to predict levels of: aedien school wevievenant. in spite "SF tot. having . | 
'/ Been designed for that purpose and (2) that it predicts performance in. 
the:early years of medical school better. thah*it does ‘in the Tater eae 


fe? QUI 
‘choices, or ratingsby peérs,.: a of grade performance by yea 


and "service orientation." The: coefficient. of correlation. obtained . 
_ between the first two factors was’.81, with remaining pairs of inter- 


- or better) while those between MEAT and the third factor; "ath year’ 


The’ Study first derived five factors or dimensions of “medical college . 


ng 
and in‘certain -4th“year courses (also-in a single 2nd year. eburse) and 


7. scoreson subtests and all tests of the NBME. The factors in order. hee 


of derivation were "first two years gradé. getting," "general achievement’. *.» . 
in medicine," "4th year..grades in. ob/gyn -and psychiatry," "sociability," = 


corrélations ranging between +.27 and -.19. Waving establishéd the 


“eriterion measures, the study proceeded to examine the correlations 


between the five criteria and the 45 predictor variables, among which 
were scores on the MCAT. The correlations between MCAT subtest’ scores 


‘and the first two factors (both basically measures of GPA in the, first 


two years) ranged from +.31 to 1 (all significant at the 205 level 


grades, ranged from +.07. to. 12, all. non-significant) . 

A ratent study by Gough wee (1975b) identified two uncorrelated - 
factors which reflect the distinction between performance’in the earlier 
and later years -of medical school of students at the. University of - 

Cali fornia- San Francisco. .Jhe factors;were labeled "academic performance" 
and "clinical performance |” While "the clinical performance factor, ac- 
counting for 48 percerit of the communality of the matrix, was more or less 
unpredictable From aptitude and premedical academic achievement indices, 


it was marginally predictable from scales on the Adjective Check List. a 
‘The academic performance factor, accounting for 31 agree of the variance .~ - 
a criteria, was forecast with acceptable accuracy, (eross-validated - A 


.R = 0.43) by equations based on the Medical College Admission Test and, 


premedical grade point average" (p. 301). In an earlier study, the 
same authors (1964) found sa#milar results, a non-significant correlation 
between first-year and fourth-year medical schoo? GPA and a greater 


% veges of patter a between MCAT and early medical school achievement. 


Hoffman, Wing and Leif (1963) came to the same conclusion, after 


‘dériving separate sets of multiple regression equations to predict the ° 


four criteria of yearly grade point average in medical school. They 
studjed twelve classes of Tulane students (graduated from 1951 to 1962) 
using -ei ght predictor variables: scores on the four ‘MCAT subtests, 


: premedical overall and science grades and two persona] interview ratings. 
_ "The results of this study indicate that there is only a slight 


rela@gionship existing between grades obtained’ during the clinical years 
and either pre-admissions data or medical school grades obtained~ during 
the first two years" (p. 856). Further, the number of classes for which 
a regression coefficient significant at the .05 level was obtained 
between MCAT-Science and grade average dropped from 7 for.first-year 
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‘grade average te 1 for” fourth-year. ceade ‘average n “for wcarquahtitétive 


Aptigude the drop was from 8 to 0. -The Verbat. Aptitude and Modern ° 


. Some y y (or General, Information) subtests of the MCAT had aly, 1 or 2 


icane Eee rn veten S. across all. foungyearse 


“ee 


he 


-In a “study of early medical scheol achieveneits Lief “Lief and 


_ Young (1965) found that the MCAT scores of: the"ten :f st-year students .-*' 
with the highest “scholastic ranking" at Tulane: -wexe significantly 
“Higher than- those of the ten students withthe Lowest anki : Gamble 54? 
.et al. (1975), however, in a study attempting to predict Se Or 2s on 


NBME-I and a comprehensive exam given'at the conclusion of: the basic .~. ss 


medical sciénces instruction program at Urbana-I1linois, concluded ‘that ' 
there existed "very limited relationships between. the sub-scores on the 
rail "180). the premedical and medical school performance eriterta® 


. 
a “ 


“In a study’ whitch factoved first and second: year grades of 


aie of Kentucky medical students in all courses into five. sepa- 
- pate ‘components, Haley (1973) demonstrated that using GPA as a‘criterion 
“masks the effectiveness: of. the MCAT-in predictingsperformance. For the 


group used in this. study, the multiple correlati ‘between MCAT and. GPA 
were not significant. But when grades were separated, into relatively 
pure components, the MCAT correlated significagtly with te, 9. the five 
factors" AB. 100). eS 


Whi Te each of the MCAT subtests) correlated signi fitant ly ‘(though at 
a. low level, .23 to .32) with one of the factors in Haley's study, 
various other studies have found that the Science subtest in particular 
has greater predictive validity than do the other subtests. Crowder 
(1959), for example, found that the Science subtest correlated .39 with 
first year grades," ~while the corresponding correlattén for the other 
subtests ranged from .09 to .21. Stefanu ( (1971):'found that the Science 
subtest correlated significantly and rather well (r = .46) with first- . 
year grades but only for a. group: of 97 University of Alabama students 
who had high premedical CPA's (col lege credit point average). For the 
group of 69 students with low CPA's the correlation was nil (r =°.003). 
Weinberg and Rooney (1973) felt that the lower MCAT - ‘Science scores of 
women were predictive of their lower scores on NBME-I. . They reach this 
conclusion by comparing national mean scores rather than by correlating 
individual .scores. (By the time NBME +11 -was taken, the Periomense of 
women was on a par with that of men. } : 

es 

Ingersoll and Graves’ (1965) found that the Science subtest was a 
significant predictor of first-year medical school achievement for those 
in an experimental curriculum at the Ohio State’ University Medical 


Schoo] while the Quantitative subtest predicted the achievement of those - 


‘in their traditional curriculum. In correlating MCAT scores with class 


rankings for 2 classes from each of 12 schools, Peterson, Lyden, Geiger 


v . & 
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"and cation *( 1963) obtained ootvelatians all less than .35, with the few 


s 


significant ones being for the. Science subtest. ‘ 


In spite of the apparently greater “predictive ability of the . 
Science subtest as compared to that of the other MCAT subtests, :° °° 
Funkenste in (1966b) and Morris (1966) expressed :'rese rvat iofis ‘about ‘its 
utifity for accuratély measuring science. ‘achievement. The: ‘points. made: 


*e. 


by Funkenstein were that, besides the usual: limitations of ahy achieve- . 
een test, athe MCAT Science test suffers from the fol lowing problems: . 


. ia 1. The welts amouhits of ‘biology, cnainetey<. 
“and physics which contribute to, ‘the total. test score 
are “unkn own to oeuecem comms ftae es. 


wee Nee “es - There are difficulties. in in keeping the test 
‘4up to date because of the ‘rapid Changes in college 
science courses. od 


3. The effect which review has on the test 
score is unknown. ” 


4. The effect which recency of study of the 
(nea) sciences has on the bese score is unknown. 
124 - 


Norris’ objection, that it is more an aptitude than an achievement 
test, was based on his findings of high correlations between the Science 


subtest and the Verbal. and Quantitative Aptitude subtests .for all those 


taking the MCAT. at both 1964 administrations. In a subsequent study 
(1967) on. the’ interpretation of the MCAT Science subtest scores of - 3 
repeaters, he again found. a high degree of correspondence between the \_ 
Science subtest and the: Verbal and Quantitative Aptitude subtests. 
Additional findings of this second study were that 60 percent of 
students taking the MCAT Science subtest for a second time -can expect to 


_increase their scores ; that ~he expected improvement would.-be about 25 


points (possible scores on ali MCAT subtests range from 200 to 800); 
that students completing science courses between testings improve. their 
stores (by about 10points) ; that the "true! score which admiss (OAS! ° 
committees should use is the, repeat test.scores; and that students ~who 
felt familiarity with the te$t would help them did opeatn somewhat * 
greater increases than those who did not. ; 

In connection with the issue. of retesting, Schumacher and. Aion 
found that. retest’ gains differ by students: ability levels. Though all 
repeaters made significant gains, .low ability students gained more ‘on 
the Verbal and Quantitative subtests, while high ability students gained 
more on the Science stbtest. The author's felt that these findings . 
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“iprowided support far the verbar and Guantpeacive subtests. as imiéasures of 


fee of senaagee porenelat. -and the Selence subtést as a measure. of achieve- 
. if ee ‘ ment: a ae ge om a sta ag 5 aes $ . —ir . 
- ne In “eon tuding: this examination: ‘OF MCAT's ability’ ‘to predi ctiifedi cal walt 


school performance. as “measured by grades, and test scores, it i's heces- 
- te sary to point out-that. the clinical orientation of the final. ‘two: years *, 
“of medical: school curricuTum makes it -unlikely: that the cognitive Me 
abilities and academic . ‘knowledge measured by MCAT. could glone predict.: a 
-* ‘achievement in those ‘years. Nevertheless, Korman ‘et al. (1968)-did >. = 
.: + find that high: ‘MCAT. scores -along ‘with. high* ‘premedical. GPA were signifi - aed 
"+. cantly rélated to-a' statistical: factor of. achievement’: in Clinical 
medicine for 62. students ‘at the’ Un'iversi ty ‘of Texas Seuthwestern Medical 
‘School. The highest loading * variab}eg on the clinical achievement 
factor were total GPA; third year GPA‘ aid ourt@iyear GPA, although 
faculty ratings. .of ° ““physicianship," peer rdtings on 12 variables and 
; internshipy ratings by supervisors were also ertered into the factor 
"|. .amalyses. (The only other factor of the five ddrived in this eae - 
which was significantly related to MCAT and premedical GPA wis that of 
“Scientist Potential (SP) -- likely ‘to accept salaried position, - 
suitable as researcher and.teacher, interested i dtageosts versus 
_ treatment" (p. 406). ). ; 


The results obtainedtiy fue e elbal and K iska, (1974); in their 
Study of the predictors of clinical performance are mqye typical of hg . 
usual low ré lationship between MCAT and clinical/last ¥yo years of. 
medical school performance. Of the four. subtests, OnaRAL MP = Sc ij ence 

_ subtest had any relationship to the composite ‘rafary ye clinical 

'. skills of -third-yea al at. Ohio State and? La@tionship was 
negative (r= - 28). ‘ae ; 


“The NCAT "ind. Physician, Performance 


Studies of Cognitive i creer predictors’ of shystetan per-- 
formance are few in number, coinp ared to, thos in 
cognitive predictays to the stort term tri. n ef medical ‘school 
performance. This sparsity reflects ‘the .d@ffiii shed importance: of such. 
predictors for physician performaricé and tWe gredter weighting: of spch 

* # .,Components as technical competence and inéA@rpersonal skills. Whilesthe ° 

'. influence of cognitive abilities is ‘not: unimportant , the shbmo genedysty 4 
high level of this characteristic in the physician populatton- (becadus ta, 8 
of the weight of this predictor in the selection’ process for: medi ie a 
7 school) necessitates an emphasis on other variables in sroresiegs vost 
_# between "good" and: "not so good” -physic#ags, -These’ éthet, variables, aa a 
as mentioned above, are concerned wit ehftical skill anid. Riowleay *s ue 

and with patient interation a ot peaking at: the First. ; a 
‘Combined GME -GSA ee which was devoted. o ‘the ec of nF physician. s ° 


77s * a 68 
ERC _ oe 


-57- 


loentomaleed Tuttle (1972) confessed that neither he nor anyone else 
pea Ty’ knewwhat the implications of physician performance were for 
gear ane called for more research on the subject. 


-- those studies which have related MCAT scores to physician perfor- 


ae have generally found little association between the two. This is 


nt 


“OF MCAT and wedi Cal SCHOOT perfor 


) eo ; 69 
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~. Quite likely due to the same “restriction-of- range" problem. mentioned 
above in regards to the distribution of physicians’ cognitive abilities 


and also mentioned previously in connection with correlational studies 

nate The” ‘probtem; towever,; -becemes--- 
even’ more acute when the groups being examined consist of physicians 
rather’ tifin. medical students. Tha former group excludes those students 
who dropped out of medical school; and, as has been reported, those who 
drop out for academic reasons have lower MCAT scores. * On the ther 
hand, students dropping out for non-academic reasons have higher than 
average MCAT scores (Motto and Wemer, 1965a; Gough and Hall, 1975a), 
are more likely to be readmitted, to ultimately graduate and to become 
members of the physician group. . 


Another probable reason for the generally low association found to 
exist between MCAT and physician performance also parallels that which 
explains the low association between MCAT and performance in the later 
or clinical years of medical school, namely that MCAT was not designed 
for the prediction of clinical competence. As clinical competence 
becomes an increasingly important factor, in the criterion being pre- 


* dicted, MCAT becomes a decreasingly relevant predictor. 


An early study of physician performance which includes MCAT as a 
predictor is that conducted by Peterson, Andrews, Spain and Greenberg 
(1956). Eighty-eight physicians in general practice in North Carolina 
were observed and rated on six dimensions of technical process. MCAT 
scores were. available for 30 persons and, when compared to the ratings, 
showed no ne tatlonsiiy to quality or medical practice. 


An wnpublished doctoral eres (Howell, 1965) reported by 
Gough (1967). and a published study by the dissertation author and a 


' ¢olTeague (Howell and Vincent, 1967) examined the relationship of MCAT 


to favorable and unfavorable supervisor ratings for U.S. Publie Health 
Service Corps career officers. In the dissertation study, two groups of 
physicians, matched on age, specialty, geographic region, type of 
assignment and year in which the M:D. was received, were identified on 
the basis of highly favorable or unfavorable spontaneous supervisor 
ratings in their personnel files. There. were 156 physicians in each 


a. 
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group, with MCAT data available for 91 of the highly rated group and for — 


89. of the poorly rated group. Gough summarized the results as follows: 


yxOn three of the MCAT subtests the differences were in favor of the 


‘physicians with unfavorable ratings; that is, those officers scored 
higher on the Verbal Ability, General Information, and Science subtests. 
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---9n--a--professionalachievemant examination in medicine, the Medica’ 


. rf * : , + * . r son ms . is . a ; ; ay , 
On the Quantitative Ability subtest the mean sgore for the physicians, ; 
receiving high ratings was 548 versus a-mean of 538.for the contrasting. . 


sample... In analyses of other .intellectt&l measures, Howell obtaiped.~ 
similar results; that is,"these variables did not yield. strong differen- 


& ‘ 


tiations hetween the higher-rated and lower-rated samples." a Ee . 


In the later stidy 4Howe It and Vincent, 1967), two criteria of | " 
physician performance were used, annual superVisory ratings on the. 
Commissioned Officers' Efficiency afd Progress Report (CHEPR) and- scores: 


Reserve Examination, Form 2 (MRE-2): COEPR yields 4 scores -based on 3 a 


sections of the report and a score for the average of the 3. The.sec- 
tions are: "Section II - 8 forced-choice tetrads scored by an émpiri- - 
cally developed Rey; Section III - 11 10-point rating scales for * . 
evaluating various persona] and work characteristics; and.Section ¥.-. 
a 10-point rating scale for evaluating overall performance" (p. 1039). 
MRE-2 also yields 3 subscores and a total, rather than an average, - 
score: The three MRE-2 subscores are for: Medical Sciences, Clin#al, . 
Medicine, and Preventive Medicine and Pubdic Health. as ree 
The striki 1y different results obtained in this single study. . 
point up the differential predictive validity of MCAT, namely that it __ 
distinguishes levels of knowledge or "book learning," but not levels of” 
clinical or "bedside" competence. All correlations between MPAT and ~ 
the COEPR scores of performance were in the negative direct{jon’ ranging - 
in absolute size from .05 to .25 (n = 123). The coafficients for the — 
relationship between COEPR Section II and MCAT subtests VA and GI (or 
MS), although small in size, were significant at the .O0t level, The | 
correlations between average COEPR score and ¢he same MCAT subtests 
were significant at the .05 level as was the ‘correlation between -COERR... 
Section III and MCAT-VA. The correlations obtained between MCAT and; 
the MRE-2 test of academic khowledge*indicate an entirely djfferent. . 
situation. They ranged from ~.05 to +.62 (n = 54), with 10 of the 16 


coefficients significant at the .0] level. Furthermore, four of the’six ~~ 
nonsignificant correlations were those between the MCAT subtests and“the. — 


Clinical Medicine subtest. That this particular subtest must include 

a large component of clinical performance is confirmed by the four. © 
significant correlations between it and “the QOEPR scores of;performance- .,. 
(r's = .31 to .38). None of the offher three MRE-2 scores, those. for 
Medical Sciences, Clinical Medicige or total score, are as highly: (or . 
significantly) correlated with any of the gCOEPR scores (r's #--.1T 


to +.14). 


In a volume which summarizes "two decades of intermittently sus- - 
tained research" at the University of. Utah-on the "measuremept and ~ 
predictors of physician performgnce” (Price et al., 1971); data: are 


presented which reaffirm the lack of association between ‘the MCAT 
and physician performancey A major part of their work was concerned 


Yr, ‘ 


with developing a method of measuring physician. performance ‘using _ be 


‘ 
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: an wnique approach which Barro could classify as neither process nor .. 
outcome. “By querying physicians, other health professionals and 
patients regarding the qual gies of ‘superior physician, they identi- 


~ four rating scales were constructed to measure these factors and their 


fied 80. factors and the respéttive weighting of each factor. Fifty- —~. 


. 4 reliabitity.determined. Three Statistical methods of combining the 54 
ratings were also devised,yielding a total of 57 measures of physician 
performance. ‘Scores on. these.57 measyres were correlated for 31 
physicians with their scores on the Prdfessional Aptitude Test (PAT) - 

“ taken’ 19 years’ eartier. PAT, the precursor of the present, MCAT, con- 

-« sisted of 7 subscales, four of which are identical in content and 
structure to the resent MCAT. In addition to.PAT, another measure of 
cognitive aptitude (and motor abilities), the General Aptitude Test 
Battery €GATB) was correlated with PAT/MCAT. GATB contains 11 sub- 

’ scaleg 4-rejated to general intelligence, :logical, verbal/ and numerical 
: aptitudes | ae the other 7 to perception and physical dexterity. 


Of the “resulting 1,026 correlation coefficients, only 55 were 
significant ‘at the .05 level, "almost the exact number of correlations 
Ee that; would be -expected to-occur “Kf chance*were‘operating in the absence 
_ Of any valid trends between predicfoy and criterion variables" (p. 124). 

The omfy two criteria predicted corisistently by 3 or more of the PAT/ 
. MCAT subscales. were “number of articles in professional journals 
*t', -* reviewed in detail each month" and ""riimber of scientific and profes- 
i. . Signal. courses. taken during career®”" The former criteri 
fe related and the latter‘negativefy, related to PAT/MCAT he conclusion . 
was that "these. findings ppint out the necessity of #sing criteria based 
on’ agtugl ‘on-the-job performance rather than those derived from school 
performance (i.e., grades and examination scores) to validate profes- 
_sional selection and training procedures" (pp. 127-8). : 


>; ° "' The MCAT and Other Considerations 3 


4 


In addition to the. question of. whether. the MCAT has any utility for ° 


predicting either medicat school or physician pexformance, other 
questions. arise. One which has been increasingly asked is that of 


‘ whether the use of MCAT is valid for students from minority or dis- °. 
advantaged backgrounds.;- Two récent‘ studies directed .toward this ques- , 
tion-came to conflicting conclusions. 2 eee 


i z one 


. ee a Fi ’ . 

Weymouth and Weryin (1976) reported on two experimental program 
at. the Medical, ColJege of Virginia, a Summer Institute and a Special 
Track,-which were designed to give academic support and curriculum 
flexibility to students with academic difficulties. Eight of the , 
eleven students in the first Summer Institute were black, and-only one 
of ‘the eleven was not rai oa aay promoted to the“second year. To9,. 
determine whether the institute had enhanced the..students' academic 
performances beyond that expected at matriculation, the regression of 


1 
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first-year comprehensive examination scores on premed GPA's and MCAT 
scores was computed. -While the equation itself or the beta weights for 
each predictor were not reported, the authors conclude that sthere was 
no objective evidence to indicate that students' participation in the 
institute significantly affected their academic standing" (p. 669). 
They go on to say that "these data confirm Evans' findings that the 
matriculant™s grade-point average and MCAT scores are rather poor 
eae of academic performance in the first years of medicine” 

p. 669) 


. 


However, Evans et al. (1975) conducted a similar regression 
analysis, using premed GPA's, MCAT scores and an index of undergraduate 
college selectivity as predictors of the interim exam and final Compre- 
hensive Exam (CE) scores in the first year, and interim.exam and NBME-1 
scores in the second year for 43 minority students. It was concluded 
that "the MCAT and GPA.do have some predictive validity for likelihood 
of passing the interim ‘examinations and the CE at CWRUSM" (Case Western 
Reserve University School of Medicine) (p. 938), although the criterion 
with the greatest predictability was the selectivity of the under- 
graduate college attenfled. e 


Studies concerned with the effect of ee class oi@iicat 
scores are especially retevant to the issue of MCAT's validity for 
minorities; since it is the educational: and intellectual background 
associated with the particular levels of social class characteristic 

‘ of racial/ethnic minority groups which is pertinent, rather than member- 
ship in those racial/ethnic groups per se. Thus, students from the 
majority, white racialyethnic groups but from the disadvantaged or lower - 

‘+ socioeconomic level of that group can legitimately be classified as 
‘ minorities. Similarly, upper and upper-piddlé class students of 
:minority racial/ethnic groups would not be considered minority or dis- 
- advantaged for jthe purposes of validating standardized tests. That their 
racial/ethnic identity is ultimately an important factor in the delivery 
of i services is another matter. 


ait study by Woods et al. (1967) directly addresses the eeeioi of 
‘Whether MCAT scores vary by social class. Students ‘at the University 7 
of Virginia-Medical School (whose minority, statuses were riot reported) 
“were grouped into three levels of social class on the basis of 3 indices 
derived from either 3, 4 or 7 of the following variables: parents’: 
‘occupations, educations and income, typé of high school attended, farly ) 
‘errvirons and number of books in the home. The results’ ‘showed statisti - 
cally signifigant differences {at the .01 level) for four of five MCAT 
* scores (the, dysubtest scores and: an overall average score) between 
Students jn the upper and lower. social classes when grouped .according to 
the 7 and 4 variable indices. Three of the five MCAT scorgs showed: . 
significant differences when students were grouped using the three 
variable index, but only at the .05 level. 
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«larger group (n = 497) also fall on the side of no social class re 
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Fredericks and Mundy (1967a) also examined the MCAT scores of a 
simi Tarly-sizéd sample of Loyola medical students (n = 82, 80 of whom | 
were ite) inrelation to an index of social class based on father's J 
occupation -agd education. They found just the contrary, no statisti-. / 
cally significant difference in any of the 4 MCAT scores among -their 
three social class groupings of students. They also found "no relation- 
ship between the subjects’ average MCAT scores agd their academic a 
achievement (in medical school) within any of the 3 social classes" 
(p. 132). ; 
Results obtained by Dagenais and Rosinski (1975) over a periodd of 
ten years at the University California, San Francisco on a much 


differences in MCAT performance: Students were assigned to 7 social a“ 
class levels using an Index of Status Characteristics. ©"The main wae 
classifer of status level was father's occupation, but this was moder-,, 

ated in some cases by total family incomé where subjects were assigned 

one level higher or lower according to size of family income" -(p. 200). & 
The authors conclude "that there are no detectable social class level “7 


differences for this sample of medical students..." (p. 204). 7 


What is so striking about their findings is the lack of any social 
class difference,.‘across the board, on any of the various cognitive and 
non-cognitive measureé used in their research, except for the ‘single’ one 
of undergraduate grade point average. It may be that the index of 
social class used is not discriminatory, based as.it is on essentially 
one variable. In the Woods study, fewer significant differences were 
obtained and the level of significance declined::(dropping from the .01] 
to the .05 level), as the number of variables in the social class index 
decreased. Thus, Fredericks and Mundy, using an’ index of social class 
based on only two variables, did not find any differences, ngr did 
Dagenais and Rosinski with a single-variable index of social class. 


Not only are variables in the cognitive domain, as measured here by 


MCAT, related to variables in the biographic/demographit domain (such 


as racial/ethnic identity and social class), but it ‘has been shown that 
they are related to variables in. the personality and tareér motivation/ 
interest domain’s. In a study of 991 students who were entering six : 
representative medical sghools, Haley et al: (1971) examined MCAT 
scores and a eiariecl cally derived factor based on,MCAT scores ‘in: 


- relation to personality measures antpiographic variables. Grouping, = 


thé students into high, middle andelow scorers and examining djféerences 
among the groups, they found that high MCAT scorers were,Jess Cop- ni . 
forming, less religious, less dogmatic, ‘less economical TWéarientéd: and 
more independent and embracing of aestheti¢ values thanewere middle: 
scorers. Similarly middle ‘scorers possessed’ these characteristics to 

a greater extent thah did low scorers. 
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~ Significant differences among the three tevels of MCAT scorers 
were also obtained in the biographic variables. Of those deciding to 
enter and actually. entering medical school at younger- and older-than 
_ average ages, a greater percentage were high MCAT: scorers. The same 
“was true of thpse having majored as an undergraduate in mathematics and 
the humanities, those primarily interested in the research aspect of -. |. 
medical ‘education, those desiring a fareer in research/teaching and ae 
those interested in a psychiatric arother/undecided specialty. A : 
getter. proportion of those using supplementary reading and other 
+. 7 Bourtes of medical information also were high MCAT scorers, Thi@ 7 UUTUTUTT 
a 4* authors conclude that the relationship shown to exist between MCAT and 
a i ‘personality and biographic variables may mean either or both of two | 
things. "On one hand, it may mean that some or all of the MCAT scores 
of individuals may be affected by factors other than those the MCAT 
purports to measure." "On the other hand it may also mean that all or 
some of the MCAT subtests actually are measuring same of these other 
, variables as well-as intellectual ability and-achievement" (p. 957). . °° 
The difference, if any, between these two possibilities is not obvious; 
essentially. they boil down to the point that non-cognitive components 
may be ‘included in MCAT scores. > : 


Two Stidies (Horowitz, 1964: Horowitz and Williams, 1964) of high 
and low scorers on the Omibus Personality Inventory (OPI) scales of 
intellectual disposition or cognitive style obtained significant 
4 ' differences in MCAT scores. The studies, conducted at Western Reserve 
University, found 8 low, but significant positive correlations between 
the, four OPI and the four MCAT subscores. The OPI subscales are 
Thinking Introversion, Theoretical Orientation, Estheticism and 
os Complexity. Thus, high MCAT scorers cah be. characterized as liking : 
abstract thought, being interested in scientj fic matters (including use 
of the scientific method of thinking), being interested im artistic 
matters and being flexible in. thought, tolerant ‘of ambiguities and 
aware of subtleties. 


o Pan ‘i , ?! 


. Along this ljne, Sanazaro.(1965), reporting on. the AAMC Longitudinal. 
Study, found that the correlation between scores on the MCAT Science -, 
subtest and senior medical students’ career plans for general practice . 
‘yielded a coefficient of «.84, while that with career plans for = 6 
research/teaching yielded a value of +.49. Apparently, a scientifically- 
oriented cognitive style, whether evidenced as OPT, score or ‘career plan, 

enhances performance, on the MCAT. # 


t 


A "New mcaTSt 


Various researchers in madical student selection have, over the 
years, noted in passing the ‘deficiencies of the MCAT. .."Jhe most pene- 
trating criticisms have been those of, Gough,-Hall and-Harris (1963) and 
4 - : ° ' : 
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Funkenstein (1965, 1966a). On the other hand, Sanazaro and Hutchins 4.) -°8 ™ ¢@ 
1963), Grant and Bennett (1968), Elliott (1969), and, yes, Funkenstein Mig 
960)” have pointed out that the NCAT .has value when employed in the : , 2 
manner intended. The test is used properly (1) alang with other > } a 
indicators of a student's potential for medical school, (2) for the. a 
assessment of general levels of ability and knowledge in certain areas, 
(3) for the assessment of whether a student can (not will) meet the wt 
Neat erg demands of medical school, and (4) for use with large. . : 
a to select out those at the top and bottom of the distrjbution.. a “* 
used-improperty~-(4+}--te-assess- motivation. {2.}.-+0- makes- decisions. emma tute 
Re students with small difference in scores, (3) ds a meaSure.of | ea % 
clinical judgement and professional competence, (4) as a single aaa 
s¢ore and (5) when applied to individual-.schools (Elliott, 1969p). ° + °° 


In 1971,\Erdmann et al. reviewed the evolution and performance of 6 @ 
the MCAT upAintil that time and described the issues relevant to 5, 4 
i id inadequacies». ia 


One possible change under saietdenation for 
the future is that MCAT examinees may, not be 
required to take the Verbal and. Quant ttative sub- y 
tests if they have recently taken’ one.or more tésts | Bee 
in other contexts which measure essentially the 3 
Same abilities. .-, Other questions, arid perhaps 
more important ones, deal with the objectives of y 8 
the MCAT. Are test results ‘to. serve,thé purpose of 
evaluating past learning or’ predicting future oo 
performance? Or are both functions desited d, 8 ie 
“if so, to, what de gree ?. oe ee ; - “ 


Mgt. 
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In an editorial thé Following A eedinann. ( (1972) paveteee’ Whe if . 
dangers -of using’a device: which ha nna some measyre of earlier 3% " 
success to meets the new ete of Pees needs “ericcnices A 

(p. 747) aie 

process, and 


achievement -teg fenin. th ee et ge sScial ‘sciences; the ‘devel te 
of a biogra@iitt ay ‘inveit y DRO “a cg te- A 9 other ponco ive " 
(affective): diitens ions the .dé a bak opment of .an educ tiona tes) 

program for}thé- users, of. the exploration of the ‘vario 
systems of pe@fopmance’ repart ING ‘ gue ty: criterjon-referenced ‘ 


ye) 
measures; rand deve loph int of erfals related to’ the cognitive and 
distribut oR gine 786) fF ly rai eae including Renn ony : 


distri but io! 748}. Os a 2 . y 
fig e is iy , 4 : . ; 
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(AAMC, eo 


Lode 4D * ALR ’students- ‘planning to énter medical. sa 


-conferences..(AAMC (DEMR), 1973a). For the benefit of membtitea 
Task Force, these papers weré summarized intb a single vor ured (2 AMC (DEMR) , ° 


1973 “for development. of specifications for a new assed 
(ibid, p. 59). 
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e “regional 
“of -the .MCAAP 


Position papers were prepared by each gr@up represented ag’: 


1973b) «and supplemented by individual papers and by posittgh, papers 
from the AAMC's Committee on the Measurement of MAP Annee 

the’ Ad Hoc Committee for Minority Concerns in MCAAP nyt 
contract was awarded to the American College Tésting Pegg 2a 


from _ 


In March 1976, a rdport to ‘the “Grougba “Hedi cal £duaBison 
progress on-the “various protects now in progress Sirough . 


at 


, The cqvised mh College Admissions Tests will g ee 4 
a , be offered fer the first. time in Spring, 1977% vi 
_Rdmass i6n's affic a in each region have votedeaes ay 
* fol) oping: rese litt pitas ie 


» 4 1978 "Must present to admissions * committee hae 
ra x 4 fot the. new cogni ti vagte ae il repyace ‘the 
af * SAT in-‘the Spr’ ng of - 1). ‘ 
"4 | 
the ne nears will repagt six sg res for each examinee: 
is ! : L 1 hates» bea = 
ee See a kills: Analysis: tediho Ae a on 
7 oe a Oe, fans Analysis: Quantitative | i 4 
a 38.4 Biol ogys ‘ (Scoresgfor, each of these three deas 
du eghem stry. . combine, a&sessment Gh oth knowledge ” 
viphys ics : i. | and problem solving. 
be! Science, Pr lems (combines ‘pro from the three 


| a 
a Oa doo! science area 


“A test; anual jiworks xercises, for ee interpretative man=- + » 


ae ual*and.a technicat Tyanual, all relating to the new test, are in. 


> 


ee, shoujd yield a. he on of the hew test witch is more ‘focused ant 


ak 


a fedicet schoo] sel 
* in: Jhis/he! lnder gray ate or premecicay: education career. In recent years, -« 


oe en | 


preparation igs ake MEK SHOPS and additional supporting materials. 


3 var Mi@tignai studies, based on national samples,. are plarined a as an 
Anteyral party of . the MG P program. The Provision for such: ‘research — 


ae Aa thané at gf ‘the old test. 


PRENEDICAL “rao eBor AVERAGE (GPA) th 
“Tit addi tipn ie the MCAT, the other major cognitive measure used “in _ 
Jon is an index of the student's: academic achievement 
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the AMCAS form has reported 2]. to 42 differently computed GPA ‘indices te 
the participating medical-schdels (for the academic year 1976-77., 86 of. 
the 146 U.S. medical schools were AMCAS participants). 

GPA's are computed by the applicant by subject area: one for _ 
courses in biology, chemistry, physics and mathematics (BCPM); one for 
courses Amall other subjects (AO); and one for all courses, both BCPM 
and AO/ These three GPA’s are calculatéd'for (a) each of the four 
years of college, (b) the total of all years of college, ‘(c).post- 


eevee baccalaureate but. not graduate work, and:-(d) graduate work. “Thus, up 


ERIC 


to 21 different GPA's are calculated on the basis of course grades as‘ 
reported -on the official school transcript. When necessary, these 21 


GPA’ s afe converted to the common AMCAS 4-point grading scale of A= 4, 


BS, etc. and, then, 42 different. GPA's are reported. 


The GPA's which have been used in predictive studies are generally 
those of overall GPA, overall science GPA,. or overall GPA for the last 
two years of college. Results of thes®isttudies generally parallel the 
ae obtained in the studies of the predictive validity of the MCAT 
>- namely, the further along the medical education/career continum is . 
the criterion being predicted, ‘the less predictive is premedical GPA. 
But, in spite of this decline in prediction with increasing remoteness 


Pass the;point of medical school admission,, the research examining the 


pre icti ve validity of GPA generally ~indicates its superiority-to the 
MCAT and, 0 other tests in ‘forecasting medical school performance at 


. whateyer. “point avong the continum. 


; It is felt that one of the reasons for GPA's greater predictive 
ability stems from its reflection of student charagter istics from both 
the intellectual achievement and personality domains. A “paper-and+ 
pencil" achievement test such as. the science br general information 
subtests of the MCAT cannot measure, in one or two sittings, qualities 
of perseverance and sustained A#erformance which, many’ say, are even more 
important for success in medical school than intellectual aptitude alone. 


GPA and Medical School Performance 


Medica] School Performance Operationalized 
As Attrition. or Progress ’ y 
‘The First years ‘of medical school are probably those which most 
require these personal qualities of persistence and steadfastness, since 

the basic science curricuJum has less intrinsic motivation for most 
studénts than does the clinical curriculum. Furthermore, since the 
academic emphasis of these early years fs quite similar to the academic 
nature of the premedical curriculum, it -is logical that GPA is a better 
ee than is the MCAT.. l 
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significant at the .05 and .01 level between GPA 
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While Johnson and Hutchins (1966) found some national differences * 
in the MCAT scores of academic dropouts and students ‘with regular 
progress, the differences were Significant at the .05. level between 
these two groups in the percentages who were in the upper 25 percent, 
upper 15, upper 5 and upper 2 percent with respect ’td their academic 
rank in college. In contrast, nonacademic dropouts differed signifi - 
cantly from students with regular progress only in the number of those 
in the upper 25 percent, with 82 percent of the former and 74 percent 
of the Tatter ‘having been in the top quarter of their college classes. 
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Similarly, Gough, Hall and Harris (1975a) ‘tained correlations 
ring “last” two 


terms," "science courses" GPA,and a gradient oF .mMe@qical schoo] progress 
at the University af. California-San Francisco wht¢ gave "a value. of 

4 to graduation, 3.to nonacademic.withdrawal, and’1 to an academic drop- 
out" (p. 945). However, “as the authors Lo out regarding - 


the extremety low coefficients’ (+.06 and +.08), "théy would be of: almost 
no value in making forecasts for individuals" (p./945) 


. Motto and Werner (1965a) considered that "of special concern (to 
their study) is differentiating between Dropouts and Highs, who in our 
sample are’ most alike in Medical: College Admission Test scores, overal] 
premedical grades and science grade-point averages" (p. 899). A.major 
ftaw of their study, though, is the failure to distinguish between 


_-academic and nonacademic dropouts which, in combination with a possible 


i. Medical Schqggl Performance Mperav ional ized 


greater representation of the latter, is most likely responsible for the 


i obtained similarity of dropout’s to high medical school achievers. 


As Grades and Test Scores 


* . 6 


‘) Because it seems intuitively logical to compare. pr 


dical ae) 


with’ medical school grades and because both provide datfa which permit the 


calculation of correlation coefficients, there have béen many studies of 
this type. The magnitude of the coefficients obtained in these studies 
has been higher than that aes. in studies of *he Peper tenshiipy Pe bNesn 
MCAT and medical .school grades. 


Crowder. (1959), for example, tained Porvelaeipas ranging from +.09 


to,+.39 wee the four MCAT subtests and first. year medical-.schdo}——-— 04 


grades at ‘the Medical College of Georgia as was mentioned in an earlier 
section of this paper. Corre}ations, between overall and science GPA and 
medi.cal school grades,’ in the same study, yielded coefficients of +.45 
and +.47, respectively. By comparing the squared coefficients,*it can 


be seen that GPA explains approximately 7% more of the variance On grades’ 


than does the best MCAT subtest predictor (the Science sybtest).. Com- 
pared to the least predictive MCAT subtest, GPA explains 21% more of the 
grade variance, a not inconsiderable increment. 


- ? 


a 


78° 


, 
it 

° 
“ 


q, - al : : ‘ ar geen 


‘earlier, the correlations between MCAT and thé tho factors of medical 
school achitvement (which were derived: principatly..from medical school 
grades and NBME test scores) did ngt exceed +.41, whittle that. between 
overall and, science GPA and the two factors ranged from +.49 to +.59. 

_ This represents an. -increase in grade variance explained of 18%.° The two 
* factors. were ‘achievement in the first two years and general achievement. 
The . third’ factor of medica schoo] achievement derived in this. hae 


In icon by Kelly (1957b)at the University of Michigan cited 


*b 


ee Nandos other’ studie’shave supported the. predictive validity of 


premedical grades as evidenced by Gottheil & Michael's (1957) compre- 
‘ hensive review of predictor bes ai which concluded that premed 
grades were the best single predictor of medical school grades. ‘In an 
unpublj.shed dissertation conducted at the University of Southern 
California, Brading (1971) : investigated ‘the relationship between. success 
in medical school (first 2 years' GPA,:  1astt_two years' GPA,, total four 
years’ GPA, NBME Part I score and intern ratyng) and” selected academic. 
and nonacademic prediction factors. The data indicated that overall 
Laas GPA was the best:single predictor’- of thedical school GPA" S. 
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Buehlér: and, ayainee (1962) : fourtd that, of 22 students graduating’ 
over the years. in the. top 10% of. their’”éTags (High: Achievers) at, the 
‘University of Oregon ,, 21 -had: one of the ten\ highest GPA's in their, en~ 
tering classes (Top Selection) : “OF. the 25; Low: Achiever groups, all 


ut 
“two are from the Bottom Selection Groupi..One may conclude, almost . a e 


without exception, that good premedical students are good medical 
Students; and perhaps almost as important, that whereas the poorer pre- ! 

‘medical students are not, on,the whole, as good, 20 percent’ of them wil] 
graduate in the top half of their class, ee 10 percent of the upper 
groups will ‘graduate in the bottom ‘half" (p. 16). 


Gamble et al. (1975) ) conclude that “ithe data of this study de fi - 
nitely give support to the use of the premedteal GPA in selécting the 
best performers in medical school at the bastc\science Yevel." Scores 
on| the NBME Part I and a comprehensive examination on.the basic scierices 

. were the performance medsure in this study done at the University of 
I]linois-Urbana. Calkins, et al. (1976) at the University of Missouri- 
~Kansas City found the most significant prédictor of medicdt-school GPA- 
to be "priok academic performance .' Other studies with similar findings 
are those by Hoffman, Wing ‘and Lief, 1.963; Hill, 1959; Gough, ‘Hall and 

' Harris, 1963; Gough and Hall, 1964, 1975a, 1975B; Kayman, et_al., 1968;. 
a Richards &-Taylor, 1961. ; 


| studies on the other side of the ledger (i.e, of the lack of 


predictive validity of premedical grades ) have been few in number and 
not Wholly negative. Roemer (1965), in a nine al validity, study of 
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predictors of medical school success,concluded that neither MCAT scores 
- nor GPA, either singly, or in combination, are satisfactory for,selection, 
ee though GPA was a better predictor than was MCAT. a 


‘Similarly, Scott. “and Flora (1974) found that "there was* a’ sugges- 
tion of a parallel increase in grade potnt Merage , National Board 
scores, and clinical clerkship grades. In a Correlation analysis, 

’ however, there was not correlation enough to make. these of predictive 
‘'value." Their study wasslased on the performance of 335 students at the 
Medical College of Virginia. In a study of 1,088 University of 

cal totnie- San Francisco medical students; Gough (1967) come s to the 


; eee: the degree of association between the two is not ‘enough to . 
" justify using only grades as a¥predictor. ; 7 


GPA and Physician Performance i fae, 
In a search of the literature for the period 1955- 2, -Winigad-and 
Williamson (1973) were abigeto discover only 27 articles rejating 
‘medical school grades to subsequent career performance.” The number of 
articles relating premedical grades to pny te performance ‘is much. 
smaller, perhaps in implicit recognition of thé tack of fruitfulness in 
this line of*research. Wingard and Williamson summarize the results of , 
‘ the research they did manage to discover as follows: "That which was 
reviewed is consistent in indicating little or no correlation bet ween 


Pee the factors" (of premed grades and -shyeician perforimanc®) (p. 311). - 
- Since premedical grades are one step further wroved from ithe criterion 
: -of physician performance, it is not unwarranted. to expect even less. °°.” 


prediction of physician parse e from them than ‘from metli ca] soo. 
2 grades. ’ . 


In his review of the unpublished dissertation by How811, in whieh’. 
the characteristics of* USPHS physicians with favorable and’ unfavorable 
~ ° supexvisors' ratings were compared, Gough (1967) says "In analyses of; 
other, intellectual measures, Howéll obtained similar results; that is) 
i these variables did not yield. strong differentiations between the eC \ 
rated and Tower - fated samples." -— - Re a Brea 
; -Predi cir: ‘Study IIT. of the peieeonayicr (971) research is devoted 
--= tol the use a ‘biographteat- information to predict’ a proftte of composite” 
# medical petfoxnance scores" :(p. 139). Threé GPA indice’ (undergraduate, 
, first two ws of medical school and, last two years of medical school) | 
‘are considd@fetecri terion maasures of performance and are correlated with 7 
15 other such érfteria. Among the other criteria are patient, care; 
financial success folder rating by a medical expert,.and success- 
recognition. .Of the non-GPA criteria, undergraduate GPA correlates most 
highly with output composite score (r = + "21h and years of post-M.D. 


experience (r = +.20). he correlations are based on a total of 333 - | 
' faculty, specialist ane general. practitioner phystetans in the state of 
Utah. ' 
7) ” 
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In connection with the issue of GPA as a predictor of medical 
school, rather than of Physician, performance it is interesting to note 
- that the correlation, in the Utah study, between B@dergraduate GPA and- 
first 2 years of medical - schoo! GPA yielded a coeff¥cient of +.65 and : 
_ that with the last:2 years' GPA was +.62. Furthermore, the coef ficient. ’ 
obtained when the two medical schoo] GPA's were intercorrelated was be 
+.72. These results are in marked contrast to the findings of most — : 
other studies’ as described earlier, in which the discontinuity between 
early and late medical school performance has been deinonstrated;--aS---—--- 
has a much smaller degree of association, between undergraduate ms 
medical school GPA's. ; 


GPA and Other Considerations _ ma 


There is nothing inherent in grades and in the construction of 
grade-point averages. which can discriminate against racial/ethnic or 
social class groups, as might be the case with standardized tests, but 
there are. certain factors which mus{ be considered in their use ‘and — — 
interpretation. Principal among these considerations is that of the 
institution awarding the grades, including its general reputation and © 
its grading standards. -Clapp and Reid (1976) demonstrated that, when 
premedical. sciente GPA was corrected by institutional. selectivity, the» ¢ 
prediction of scores on a University of.Missouri comprehensive examina- oa 
tion and on the NBME-Part I.’ significantly increased. This was also true ~~ 3 
a the prediction of instructors’ ratings. o a 9 * 
vo The findings of Hill and Heck (1960) were similar and were tempore 
thee by a caution that; though an adjusted average might be’ used as a factor 
in denying an applicant admission, an instituti s grdding standards 
should not be-tused to reject all applicants frdpethat institution. o ah 4 


sors: 


The. findings of evans: et al. (1975) endorse the high predictive ™@ 9 
validity: of selectivity. of undergraduate institution. They'examined 
traditional criteria as predictors of the success of 43 minority . 

students at Case Western Reserve in passing first and second year interim 
-e “exams, a first year comprehensive exam and NBME-Part .I at the end of the © 
".8econd year. The traditi@nal criteria were MCAT scores, science and non- 
science GPA dnd selectivity éf the undergraduate institation as rated by « 
"Astin score." Regression analyses based on each of. the 4 OxaMination 2. gen! 
“eritéria showed that’ the Astin score was ‘consistently the best predictor ° 
of exam performance (dt the .01 level for the first year criteria and at 
‘the .05 level for the second year criteria). In additiom,to Astin score, 
iGPA significantly contributed (at the .05 level) to predicting perfor- 
.Mance on the first year interim exams, while MCAT did so for first year 
comprehensive exam success. Performance on the. first year interim exam 
also contributed significantly (at the .01 leve]) to predicting-first 
year comprehensive exam success. Similarly, performance on the earlier 
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~ putility for predicting medical school perfp ymance and, more recently, “+ 


exam was significant fe < .05) in predicting secorid year interim exam 
success. Astin score was the only significant redicae ot NBME ~I 
success or failure. ts ; al 
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Another ‘qualification which must be considered. in the interpreta- 


, tion of grades and GPA's is that of the particular subjects for which . " 


‘the grades have been received and the level of work Ai. e. whether . 
introductory, — intermediate or advanced), in-the course for which:the - Z 
grade;was assigned. It has ‘been “pointed out that grades forcourse ae a 
in the more difficult subjects and at more advanced levels‘should not. 

be weighed in the same manner as those ‘for Tess demanding work. | - 
Anderson and Gamble (1974) contend that the loosening of science course 
requirements by the medical schools has encouraged students ,to take’ the 

easier courses. (For an examination of changes in course requirements; 


‘ see Littlemeyer, 1969.) Similarly, ‘the averaging of grades in* ‘subject ~ 


clusters, for example science GPA, should allow for the recognition 
that such indices are based on a di fferefitviumbér of credit hours for’ 
each student. The greater “the nyabec as hdurs ‘upon which the. “index is 
based, the more accurate is the ou) rs pof the student ' S achievement © 
in that area “(Grant dnd Bennett, 6B), 
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. Ss Non-Cogn‘ tiv Selection mt Factors, ee ee aro 
ost ; re ee 


While the use of non-cognitive ‘Selection, factors has fae been 4 ms 


. institutionalized inthe medical scfiool admissions process to the de guge . 
that use of cognitive factors has, neverthelegs, a fair amount .of : 
nes been conducted over the lasttwenty years in examining the ° 


dictive validity and utility of ‘such factors. Research on biographi / e7, 
Laparanhie variables has ceftered.on discovering which variables have 


which can predict such career d@cisions ag specialty choice and practi#@y : 
location. Research on personality variabJe's in-the admissions process ie 


_has ‘concentrated on their role in determining medical school performance - 


In & detailed study of sample cases illustratin the. different ‘ways in 


which the cognitive indicators for a:single applicant might be dis- . . 
crepant, Funkenstein (1965) demenstrates ‘the utility of nonco nitive ° 


--tnformation: for resolving such- discrepancies... 4,Cedthantl (1962 had atsd.: 
mB eg" 


urged this, Saas said of non=cognty Ve. deta. A 
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The major source of data in the “admis3iops : brocess _ on the. pickaroind 
and demographic characteristics of appligants i the application form. 
The information which is derived from intervé€ws and letters of recom- 


.*mendation on <these types of characteristics supplements. that requested 


a ‘ 
é 


A as 


on. the application form and usually explains extraordinary circuntances 
in the: ‘applicant's background which cannot be fully described in the 


ate space ‘allotted on the application. The primary use of letters a me Pe 4. 
xf “interviews is in the assessment of personality characteristics ahd cs 
ficGgrinterests, ; . . y 


~The survey conducted in connection with the AAMC's Fourth Teaching 
tute “stiimarized the percentages of medical schools which requested 
of various, pie: es of information on the application foyth'a( Ceithaml , 


es US): That’.’s tin is- reproduced in Table 4.2, with those-eces of 
{niormat tb Ise requested on the present AMCAS form indicated with a 
an py dash. AS-mentioned earlier, 74% of the U.S. medical schools By 


; Fticipatad: if “AMGAS:, for the academic year 1976-77 (AAMC,°1976c) and 
“can}, ‘thus.’ be? isons t deine t& have. requested the indicated bits of 
informattant.- *Soine: “ “Of. these “AMCAS schools also require applicants to. 

_ comp Tete ee upp lene taey: ‘application — form which is unique to the school. 
: ‘Sohle “of thé .nor- RMC i$ schools use a form very similar to that of AMCAS 
; Jtihi-le“others use forms that are quite distinctive. 


7 . 


The information requested ‘on application forms is of two types: 
(1) biographic, describing a history unique to the individual applicant; 
and (2) demographic, classifying individuals in terms of attributes 
possessed by all members of the applicant population. Much of the bio- 
graphic information is used to assess charactéristics of the individual 
which really fall into other domaifis especially’ into the personality ~ 
demain. Thus, some types of "extr acMirricular activities" might be 
considered a reflection of both fee and leadership abi ity. HOWw- 
ever, a major problem with this use of biographic information is that 
it is based on scanty evidence relative to (a) which personality 
“concepts are being tapped by which biographic data and (b) the degree © 
to which biographic data.can accurately assess such concepts. For ~~ 
example, does "academic honors received"vreflect intellectual ability or 
academic interests-or capacity for work and perseverance? Probably, all 
three, but how much of each is reflected in the single biographic item? 
‘Even more importantly, are any of these concepts predictive of medical 
ad or physician performance? \ 
In fact, this confusion of the characteristic being: asessed with 
the procedure by which*it is being assessed is particularly acute in the 
entire non-cognitive domain. See, for example, in Tables 4.3 and 4.4 
the multiple uses to which the application essay and the admission 
interview were put by participants in the POurEh Teaching Institate 
wee and Cowles, 1957) - 


( 
.+ . Becaus€*the majority. i canes items are primarily aimed at : 
concepts which are herein classified as personality: characteristfcs, they 
; shal) be dealt with in that: Seer ION 
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: Table 4.2 a _« m3 ‘ ' 
’ a ‘ ; INFORMATION REQUESTED ON APPLICATION . . 
: : FORMS BY MEQICAL SCHOOLS* a. 
+ ‘ ; ?- eo a 

? tof , : 7 tof 
Information on forms 7 90 oe Information on forms 2 90 sthools 
us of oe ? sg i o¢ he &. | Hhourseg tn organic chemistry previously taken eben + 
*Schools revious ly attended Church? affiliation or religion am 
“Name of parant or guardian a we , Name of college or university now, attending “, <2Y 
*Dates:of attendance at previous schools 7 oo ee medical . 5 
*Home address : } : ‘ 
ose ee ees | 
* r : . 
mae ie 89 Length of residence in state of schoo! to 
*Place of birth 87 which application is made 7 
-Have you taken the MCAT? 83 Names of relatives who have attended sched) 

“Were you ever previously enrolled in . . to which application is made '¢ 14 

nedical school? :™ . 8) *Field of concentration at previous schools 12 
“Address of parent or guardian Y . 2 eae if previously dismissed from’ i. Ay 
*Occupation of parent or guardian : Pi r schoo 
*Date on which MCAT was taken : 79 To which other medical schools have yo0, ‘3 
Military service “ 9 79 agp l4ed? ve 42 
Plans for financing medical educatton 78 Name and/or address of Jipios en advise 
-in wh{ch medical school were you 5 - Apes or atl dismigsed from, ‘3 

2 e 

ALL pnytlcal nordicos 68 “*Length of military setvice W 
“Dates of previous attendance in medical é aa Decent inet es of study because of ‘j 

schoo) 
~Occupation since last attendance & school 62 If not a citizen, steps taken to become one 9 
Have you applied to this medical schoal .. 
_ before? 60 Request for essay ’ 
“Draft status or classification 52 : és 
eee rat eer : 
a eee 44 State reasons for. studying medicine _— 37 
*Eatracurricular actiyities 43 Include statement pf. extracurricular. a ‘ 
*Dates‘of military service 40 activities : 7 
*Any previous dismissals fenm scRan!? 38 ey has a wor Baba cae nee 
*Academic honors received ° 38 tate reasons for applying to s ii 
“Public law entitlements yy if veteran 36 school “ kK 
*Telephone number 32 Include any academic honors 
*Age 31° , . : 
Number of children 3 Request_for. reterences 
*Summary of under§jraduate courses 29 ‘. 
hia nee hte “i pale age 29 State names of character references 30 
ieee ae oueAE: - 2A - State names of academic references i i 27 
e at oe ; f i State names of professional references 18 
Dates of previous attendance at professional { , 

(nonmedical) schoo!s 27 Blanks for academic references, included 28 
Neteselty oF part-time work . 27 Blanks for. cbaracter reference’ tnc luded* 3 
*Reasons for dismissals from school - - 26 Blanks for’professtonal references inc tidad 1 

: ‘Request_for health data he , 
, . ‘ Health-report forms 4 24 
de i ‘ef oe Fy a 
Source: Cefthan], 1957. p. SO * \ 
& ‘ 
.  * Starred {tems are requested on AMCAS application in same general format. Items indicated by a dash | 
Ovgrlap with those on the AMCAS form, but are requested ina different format, e.g. 4n combination with | or , 
other Items. See next page for information requésted'on AMCAS lication but not listed above. 
pp 
a em 1: : . 
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: lnforhation Requested on “AMCAS hgpl cat fon 24 
srs: But, Not ted*in Table 4 


‘2 peNon- Citizenship: type ‘Of visa 4 my 
7% Sex * os oe a ° 
* Education: of: sarknes ‘ guardian -? 
Age of dependents te ahi ann 
¢. How.'do you describe yourgelf (racial/ethnic identity)?> |’. : 
we * DO you Wfsh tobe cons+eBred as a’minority group. applicant?” — 
a _ Age of your brothers’. *-» 
me noe oF your Sistersete mae FF ss 
re * gradtra @, OF rotessional schools attended: & 
— eg Ses expected 4 : 
8 Candidacy for graduate degree - , & on 


, Highest ‘rank attained in military ~ 
o4 Type of Military discharge 
Military reserve status 
Selective’ service status ; 
Summer jobs during college: type of work and®year 
Exployment. during school yean: «type of work and hours per week 
. AMCAS supplementary totals ataburse hours 
= GPA's and credit hours - AMCAS conversion 
MCAT scores _ : 
Plans to take or retake MCAT after submitting AMCAS application 
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COMMITTEE ESTIMATES OF YALUE OF Pesav AND/OR | 
’ AUTOBIOGRAPHY IN APPRAISING APPLFCANTD a uk 


"(Committee menbers grup) moe LM 


“s 
i praisal from essay and/or autobiography 
; ° * 8 r) 


_—___-t— 


ar 


Indication of applicant’ Ss proficiency in 
English composition and grammar 

Indication of sincerity of applicant 

Check on motivation of applicang, : 

Appraisal’of applicant's handwriting ttt 

To help in the detection of abno ] Dee 
personalities . 

To yield information for use in subsequent 
interviews with applicant 


Other , 
‘ “of the 534 committee. members , this 69 per cent said they used Hie gssay arid/gr ‘aptobiography in 
approteny applicants. pune ‘ oo 6 
' Source: Gee and Cowles, 1957,-p. 20? . ; * 
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* mental handicaps (speech im- 


? - a th , 
2. +’ OPINION ON POTENTIAL ADVANTAGE OF INTERVIEW TO ‘ScHOOL “ ae 
es IN RELATION TO EXTENT OF USE,OF INTERVIEW lo 
(Participants 2 up = ee . : 
. - bas ; ceeds * 
m 3 DALAT | eerinbicl 


é ‘i ¢ . ° ‘ 
Potential advantage Evaluation by.s of 65 schools a waluatfon by®% of 26 schools: 
. of interview using Jfiterviewsmuch - te Keguiintertie some, little, 
: ee er or not at all 
: Lae. 2 : “ ry 
Noo T Et Rea Much No re- No ittle Some Much No re- 


value valve: 


: 298 gvalue sponse. value value value vakue sponse 
’ wae: ae *s . 

It allows the admissions committee oe PT PE ak ey ae 
an opportunity to verify and we ; a es Saat a . e 
clarify information obtained | RG : : : 
about the applicant 

It permits the conmittee to ascer- 
tatn whether the candidate poss 
‘sesses any obvious physical or” 


Pediment, tics, etc.) 

It affords the interviewer an 
opportunity to delve into an 2s ; 
applicant's motivation far the *_°-:: 
Study of medicine oath go oN? 

It gives the intervrewer an © |: 
opportunity to give the appli- 
cant detailed informstion 4 
about the medical school 

It allows a first-hand evaluation 
of the applicant's ‘ntellec- 
tual abilities 

It permits an evaluation of the 
applicant's cultural! breadth 

It affords an opportunity to 

. assess the applican’’s 
abtltty to withstand stregs 

It permits observatiun of tne 
applicant (poise, frankness, 
bearing, ‘etc.) 

It permits an assessrent of the 
skill of the applicant in 
interpersonal relationships 

Other 


‘Source: Gee and Cowles, 19574 p. 205. 
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‘ Demo raphic variables, on the other hand, can My nterpreted much * 


‘La ‘more straightforwarly, “since. there.is no filter of measur ment progedure : 
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- this particular finding was deri ved From, 7 


‘school performance, are supported U¥ttf 


or eee operationalization to obscure the: picture spit 


fact, Sanchez (1975), in calling for an increase in the nu Le 
mifrorities admitted to medical’ school, considers that minory: 
a dess arbitrary triterion than mahy others now used in the ‘a i 
‘process. He contends that ‘admissions. igies have been vague, 
recent Years, "Social needs and pieeew a é 
precise formulations.' , 


e * f 


ea Hedical School Perfi ma bs 
5 he: Xe ~ 

.. In their ‘comprehensive study of attrit VOR 
(1966) examined’ 14 demographic characteristitg Malay 

showed a statistically significant relationghay iB 
Students making: .“igregula progress" werescpteg tag if 
repeaters, aca amc dropouts, nonacademi qvdropout, \ ¥ 
three preceeding categories. It was" found that" Noragademic dropouts, eee 
and the total irregular Power tents had more sibliggs than “student s, sa 

with regular progress. Fewer students in atl. AGar. of. the grotips with 

irregular progress-were m rriedy. chowever ; acadaitie dropout s -had mere, 
children than regularly p gredsin students. A ‘smaFigr Yr pércentaga fy" 
the fathers or other relatives Ff. onatademi c -dropaues ere’ physc jan ns” 
and the educational level of ‘theyghothers of - “students? ‘fn, the total a 

irregular progress group was ‘sae — gt ae . a ‘oc 

a 4 &; 104 

There were no si gnjficangfal trertnes pomee aalaie ned’ oe 4 

at which dropouts, re ers’ ant. studaht sBwicth regular pro ress entered.’ ee 
medical school, but @a#trong negative ¥elatYorsbip was ge ‘between’. a g OMG 
age atfgntrarce and - nGbiNt - of. #ropouts.-» The relationship was greater a 

for academic than "£605 HANRac adem? battrition.. It Was also “shown that 
women had higher dropiist rates: than did: men, “but the discrepancy was. ; 
wider with respect to non -academic than ta eRU Pe eae Since 2 
fa an 19 798 entragts , rs 


seems likely that, with today's mgre- Suppo 
medical students, sex may become an. inyatid predict dr on Wedel SCOT! 
performance in the future (Johnson, aga Sedkacek , —1975).,~ a gf 
hits enhancene . of adios v4 a" 
rk of others’ fife yre and 
Goolishian, 1964; Motto and Werner, 1965b), though, in thejr re yen 
jeter. 
* 


*,  The’findings on marital statusf 


Gottheil ‘and MichaeJ (1957) coatluded jt Ras an unimportant i 


. They came to a aidan conclusion regarding the Supurenice” of’ age “*," . 
at entrance to medical, school as a predictor of medical school peer oe 
mance. However, in agother study, age was shown ‘to distingui sims 
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students’ oe coh at the end of the first year froin those ranked | .*: 

-_ slow, such Per the older Seudenes: tendey to rank lowey. (Lie fs liet “and es 

. ;* Noting. 1965 ). wf ap * eo a 

- 8 4. 4%Kelly 195 / found age to be” “negatively velsked 200 she ee ee 
ty ge EF call ly“deri ed factors: of achjevement . in the first: tHo years®of Gerald te. * 

a tone achfevement . Haley et at. (3971), in examining the Chardcteri stits Qf. .: “x 
“those students: with. low, meddle and high MCAT factor’ s€btrdé,,¢found that - ora 
the percentage distribu 4on of those why entered medicals seheol eat’ less, "#3? 
. ‘than, 21 “years. of age-vas such that th were more high’ and fewer *lw ns, ‘s 
*, scorers than those éntgring at the ages of 21-24. Half of, thi's J atter o o 
~°. qgrdup wee middje scorers, one-fourth were low scorers’. and one > urth os 
“ "were high-scpr€rs. Of' those who were 25 years of age or olgersat = an 
“medical school, their scores on the MCAT factor, mee fey. oes 

ee anes the’ Tow middle and high categories... 

” Demographic Variables And . as ° so os ‘ e 
" Physician Performance © . 4 : we ~ m é a 


og 


: i The’Utah studies of physician. performance (Price et oc a] ae e 
a “examined the prediction of career performance from bio aphical ty 
*” . ‘medical school information in Project B of thei gig Stdidy, IF 
RB: “What they called "biographical" predictors are : eons y indjces of be - ‘ 
g&’ *medical school performance, oné* of pile ale be considered a proxy , 
hes _. demographic variable. No outright demogFaphic variables, were used. $ 
. “ The proxy, age’at medical school ‘graduation,. not entree was oo 
. in relationship to the vari ous’ performance criteria MBnile age a ' 
: graduation is not perfectly ceqrela d with age 4, tr@pice, due:to- ae ib 
‘ Sgr erent rates at which students progress througt¥ime'di c 1 schol , it ‘ 
can, nevertheless, be.used as a fairly close approximation. era ‘ 
students who are older than average at entrance will gemera fy be, 
older- than average at graduation. § a 1 


ae 
»p- ) 


“The results of the Predicfor Study- prosect B correlations, wht ie 

_ are based -on a sample’ 9f 50/7 ae above-average age (more than one + ce 

. Standard deviation above thé mean) to-ke negatively related to two ~ in 

indices ‘of ‘medical schooY GPA (at the °05 level of significance for oo 

first- two «x6 ars GPA)’. “ Average age > howéver ; was positively related to - 
GPA durin rated first: two years - 05) ¥ Above-average age was also- 

ii Ae related to ratings of ehydician performance (p < 05), while. 


under-average age was positively correlated-(p < .05) with this ’ 
*.. criterion. Age Was also shown to be significantly related to the type, 
> of practice in weich the physician was engaged. Thdse older thant ol 
\ average were more often in generat practices while those younger:thas 
\ average were more often ‘In -specialty practice. it should be. Note: 
that “in response to societal néeds for divégsi 
“type of practice and. -spegialty area are inc 
of the criterion of physician; perfor nce .,, 


- oo. Bg 
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7 take te “ih sg Study which directly examined the relationship between 
- Yeats gadeimi ¢: “Ber ormance and career preferences ({Lief-et al., 1965), it 
4 ‘% wage found shat lower ranking students tended to chodse general practice 
a ten. They also were more SY, to marry earlier and come fyom 
Ly Pac town. ; , 


eM a + he 
wy 


the particular configuration of “Characteristics, -- small town 


— AAA Origity preference for general »practi‘ce and lower cognitive characteris- * 

\ : wetics. -f: was replicated by Haley and Paiva (1969). Theygalso report 

: Cer alae and social orientation tobe part of thay at earn 

en § % 
; ete ‘ig , Cullison et al. (1976a) likewise found that the size of “the city or 


ss) 
maa sm from which a student originates | +s related to the specialty which 
og a of ‘He/she chooses and to the location in which he/she PRSeEIES? 


a Colwill (1976) carried the association between hometown size and 

ow spractice location further by demonstrating that it is the combination of 
a@-rural background and a preference for fami ly practice which is most ° 
on “likely to result in a physician' S practicing in a rural-area. Thus, ~ 
Pg ee cae rural or\small-town’ origins ‘are more likely to be accompanied by 

a -a preference for family practice than are more urban origins (as shown 

‘by Haley and Paiva, and Cultison et al. ), in those cases where family 
GE practice is not preferred, the probability is much lower that the 
vay as from a Pural background wil] preeulee in-a rural area. 


a 6 a survey enone by Schroeder et al. (1974) the career 4 

ro intentions of applicants affected the decision to admit or reject in 
39% of the academic medical centers. Forty-eight percent of these’ 

centars indicated they formally reviewed the career choice ofztheir 
students at graduation, 15% five years after graduation and & paten 

; years after graduatipn . ae eg 


In a report on the specialty. and location choice of physicians * 
conducted for the Robert Wood Jofinson Foundation, Yett (1976) and his 


.the literature on predictors of these physician career choices is. 
fragmentary. , They felt that there is a need to clarify further. the J 
8 characterist{cs which are associated with location of medical practice 
in at Mien ea, area. ee 
Mattson. et al. (1973) report on results of a joint. program 
established in 48 by the. I1]linois Agricultural Association and the . 
% “Illinois State’ Medical Society in conjunction with. the University of 
Illinois Médical School. “The program is-based on the preferential: 
admission and/or financial assistance of state residents with below \ 
normal academic credentials who-w@amit themselves at the time | of ; 
application to five years of the practice of family mediqine in a rural ob 
area. The effectiveness of the program is documented by the fact that, 
rs though one epectallty saeneree students had a higher attrition rate, Noa 
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‘ #8 cc J . 
my ke | 
* ‘ 2 n : ; 7 3. ay . « 
a much greater percentage of ‘those who did graduate eventually located 
in the state, eventually located in a rural {area of the state, and were 
in general practice than was true of the regularly-admitted students. 


In fact, for the state’ of Illinois, "the program produced almost .all of 
the rural physicians during the period covered" (p..328).° 


ps 


—is\pot very often used as an admission triterion, as in | Illinois. 


\ While an outright committment to-practice in an undenserved area ~ a 


program, the demographic factor of legal residence in. the same state as , 
the medical school. to which the student is applying is q criterion now 
used by pracRically all publicly supported medical scho§ls,:' In the 


majority of cases, this criterion is emphasized in the schdbl 's entry,” 


in the Medical ‘School Admissions Requirements Handbook. a RK ? 
Perlstadt (1975) contends that state residency, MCAT-Science score . 


and tuition are the three factors which really control the admission 
gateway. That this admission criterion, state residence, is not 
completely predictive of a medical school entrant's first practice 
lacation, let alone ultimate practice location, is attested.to by the 
vartous studies.on the factors influencing physicians’ mobility. = 


.S 
PERSONALITY .TRAITS AND INTERBSTS< & ia’ a 
The primary focus of that- part of the admissions process concerned 8°47 . 
with personality traits has been an attempt, to capture what are, os 
compared to cognitive and biographic/demfaraphit Characteristics, rather 
amorphous qual?ties. Jhese attempts have been @lirected towards identi- * 
fying those particular’ personality traits which influence madical:sc olen Cc 
performance and towards determining they extent 48 their influenc 
Lately this céycern has widened somewhat to include s study of their 


relationshjp to medical specialty and, other a i erences. \ 


¢, 


interest in and motivation’ for” a medical career. Becayse th same 

general sources of informatjon are/used-to asses$ interests and © 

persogality traits and because personality traits and interests are 

themselves interrelated, these two types of admissions factors shall be 

considered together in the present section. _ ; oar ‘ 5 
There are three basic Sougces of'data on an applttant's personality 

and interests: the interview, structured personality tests and the 

application materials, including an essay by the applicant and letters 

of.recommendation.- Table 4.5, shows:the extent to which pary Zz 


¥ 


ee . it . i 4 : , ; 
The issue of carée% prefétences is part of the broader issue ‘of . : ~ 


at AAMC's. Fourth Teaching Institute used various sources o information 


to evaluate noncognitive Characteristics of applicants (Ceithaml, 1957). 1. 
It is clear’that the interview eth eeibaiegs evaluations (or letters‘of.- ig a: 
upon tg provide noncognitive. iy 
oS _ 9 Rs . - : : | 
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TABLE 4.5 - 
— - . : P ‘ rt 
vhs, PRESENT USE OF VARIOUS ‘SOURCES OF INFORMATION IN EVALUATING ; . ar 
, NONINTELLECTUAL CHARACTERISTICS 4 
. (Participants group) ‘ | an aa’ 4 


% of 91 participants citing extent of use 


Source of information . Not . No 
None Little Some Much Obtained Response 
2 U L bd 
The persgnal interview .¢ 0 3 BB 72 1 1 
The psychiatric interview , 7 27 2) 4 40 a 
‘ _ Objective personality test reBults : 13 16 2 4: 62 {3 
Projective personality test results 7 ' au 1 2 66 3, 
. : & Vocational Interest test results f 7 15 7 1 59 1 
i -AbIlity and achievement. test results| 9 9 26 29 25 2 
Premedical committeé. or prenedical : e 
adviser evaluations 0 2 29 68 0 1 
Written evaluation by: premedical instructor(s) 1 8 39 50 1 ly 
‘i Other written evaluation _ 5 23 18 7 3 44 
Health report ¥rom student “7 22 37 16 7 17 . 1 
Health report from physician : 4 8 25 40 22 1 
Extracurricular activities © . / 2 Wo» 56 22 2 1 
Chronological continuity of education through * . \ 
v high school and college N z 41 Pal 1 1 
Work experience 9 27. 53 8 2 1 
Information concerning financial need 10 2s 49 12 3 J 
‘ pal ord shah . 4 42 28 1 a 1 
Autoblographical sketch ‘4 2 16 25 1 42 1 
Essay on selected’ topic (other than : 3 
autob{ography } : 6 4 16 3 69 2 
Other data from application blank 3 6 ~ 25 jt0 ) 55 
Other nonintellectual appraisal ftom source : . : y 
not mentioned above 5 - 6 7° 4 6° 1 79 
ee ee —————- —-  -. Jie J eee eer et 
a] 
Source: Ceithaml, #957, p $3. . ‘ 
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_ of. the interview. 


2. 4 é & 
information .on ‘the applicant, which will hopeful ly forecast his future 
performance. tet us consider first the interview, since it has -engen- 
dered much more discussion.and investigation than have letters of 
recommendation... : 


“e 


The -I rvie " 
te oe Ae a! 
a In a penetrating study of its own policies and pirocedurés, the | 
Harvard Medical Schgol Admissions Review Committee recently concluded 
that there were two especially-controversial issues oncerning admissions 


procedures (Report..., 1975). Une.of the two “issues/waS the role of the 


interview jn admissions.” Proponents of the interview felt that it yields | 


data which-better distinguish among applicants .than/ do the data from 
letters of. recommendation, the MCAT and GPA's. Sinte the latter are. 

almoSt .universally excellent, most Harvard applic ts appear to be very 
sinfilar. Opponents of the interview contended that ‘there jis no. actual 
proof of its value and that, furthermore, the dat'a obtay ed-are different 
from one interview to the next. Besides recommending Gifidelines as,‘to 
which applicants should be interviewed and by whom, the Report called for 
revisions in the use of the interview. Specifically, the committee 


in, order that the same type.of data be collected on alllinterviewées. 
It als@ recommended that the process of intérviewing: b separated\ from’ 
sthat of selection,’so that the interviewers not ee ly involved — 
in the final step of g@lection which is taken by the admissions 
‘committee’. <a i oS 

sad) = , , 

. The two opposing views of the value of the interview. seem’ to have 


recommended that there be a greater degree of structure-,to the nese 


‘changed little-cver the™last two decades. In+a critique of the inter- 
‘view made to the Fourth Teach 

- “all evidence suggests that it gives a great deal of satisfaction to 
‘,»-the persons who use it; : 


fing Institute, Kelly (1957a) reported that 


hey usually feel gogd about it, but i lh 
gate in any of these invéstigations the\uti lity 


netsbeen .able to demon 
sé, in view of its, cost’ fh terns: of professional + 


. - 


* time, our findings ‘aise serious ‘doubt whether it can be defended as 


eek OS Procedure pet Bl - one 


- # 
‘ 


" Both Kelly and Glaser (1958) predicted that, in spite of its draw-. 
backs and’the evidence which negates its predictive validity, the 
interview would. continue to be an important part of the admissions 
process until mote valid techniques were devised for selection. 
Apparently such techniques remain to be “devised, since a recent survey 


Of admission, policies and procedures (Char-et al., 1975) found that 
" « there was an almost universal reliance ‘by; the medical schools respondin 


™~ 


As 


“ 
> 
< 


her Ia, 
to ‘the Survey on three parameters for seTection--- GPA, MCAT and the ia 


“interview. Furthermore, the survey found a general feeling of dis- 
satisfaction with all admissions processes; but especially with those 
in:the area of assessing personality pee ecu for clinical 
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_ <Divergent. “views on’ ‘the. utility of. the interview were ‘again 
ra: @? se? i a 
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A‘few Sbudies have addressed themselves to specific problems with 
the interview. Handler (1957) pointed out that information, derived 
‘ if taken. at face value.~ As an 
example he cited his finding that’ "Most women are quite sensztive to 
the fact that théy are being discriminated against, ‘and most: OT, them 


‘are. quite sensitive to the fact that it’ is very hard tb combine mother- 
-hood and a careér in medicine., I have seen quite Teémig ime 


} women in 
medical school who have hidden their femininity; some have denigd it to 


*9, 


themselves because they felt that it was just not right’. (p: 72y. 

” Becker (1956) demonstrated that misleading inte rvik in gomhat ion 
can also result from the interviewer's manner as well as from the 
interviewee's reBresentation of him/herself, which Handler had pointed 
out. Becker found that, when thé interviewer displayed a’ pragmatic, 
realistic orientation to medicine as a career, students were inhibited 
from expressing "idealistic" motives. Conversely, when the interviewer 
was “idealistic,” students refrained ftom any expressions of cynicism. 


‘ 

A proposed way of dealing with-"faking" and with the variation in 
interviewing sgills of the interviewers is the group interview (Jackson 
and Kellow, 1958). In an experiment’ tg assess the value of this 
technique, 129 applicants to the University of I]linois over a period 
of three years were interviewed in groups of six. Twy assessors rated 
them on each of four cateyories of acceptabi lit on the b 
attributes discerned from the individual's participation in t YO.uUp . 
discussion. It was felt that the. group interview tested the carnh 
ability to use knowledge in a social situation and provided greater 

s 


discrimination among qualified applicants. 
7] 


% In a diametrically-opposed approach, i.e. increasing the numba of 


‘interviewers, rather than the number of interviewees, at a single 


interview session (Char et al,,; 1975), it was felt that the team * 
approach had the advantages of (1) yielding more interesting -and 
stimulating interviews, (2) helping interviewers to be more objective 
and comfortable in their evaluations, (3).identifying the biases of each 
interviewer and correcting:-for applicant -interviewer mismatch and : 
(4) revealing more of an applicant's pefsonality through his inter- 
actions with several interviewers, This procedure, used at the 
University of Hawaii, involved a three-person team of psychiatrist, 
psychiatric social worker and second-yéér medical student who rotated * 


“as principal interviewer and as the person responsible for writing up 
the interview. Each interviewer rated the candidates on “emotional 


“ stability, basic intelligence and organization of thought, capacity 


for empathy ‘and warmth, interpersonal relationships, psychosocial 
adjustment, self-identity, ethic$ and morality. The team members then, 
oS ies + 
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‘ applicant attr vbutes. on a six-poin 
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met to discuss eae jndividual evaluat iorfs ‘and to write a composite 
report on the applicant for the Admissian Conimittee" (p. 193). 


Does the information collected in the interview, regardless ‘Of its 
validity, predict performance in medical schdol? In their study of the 
intellectual and personality predictors of first year academic success 
at Tulane University School of Medicine} Lief et al, (1965) summarized 
their findings regarding the interview as_—fol lows: - 


Our data tended to confirm the now generally 
accepted opinion that admissions interviews were - 
: ’ of no particular help in predicting academic — © ge 
achievement. The quantitative ratings made by. the 
interviewers at the time these students were can- 
_g@idates for admission showed no, significant , 
"difference between the upper and lower ten groups 
Ap. 116). 
at vas . » 
in “another study which examined the ability of the interview to 
predict academic, achievement (Richards and Taylor, 1961), those appli- ° 
cants the University of Utah Who fell into the middle group ‘of 
neither outstandingly superior nor obyiously unqualified were inter- 
viewed by two to’ four members of the admissions committee, each of whom 
rated the’ applicant on personal characteristics, chances of success and 


recommended decision. The three ratings were averaged Over interviewers - 


:and were. found to be highly. intercorre lated. One possible interpreta- 
‘ tion af the high intercorre lation might be that it reflects:the 
inability. of interviewers to asses§ distinct characteristics indepen= 
dently and instead to produce an overall global - assessment of the 


“applicant. When the interview eo were correlated: with first, 


second | and, third year GBA, the 


ghest coefficient was -+ . 32 and the 
remaining coefficients: sfuch lower. : 


Fi t 
: ‘ nr 


. 


Bey Burge ss et al. - (1972) found that Sue physician and non- 


dhisieian interviewers: whom they were comparing, gave overall global 
impressions ‘rather, than an assesshen’ of indiyfduat personal charac- 
‘teristies, even thaygh ‘they were ae to rate each of ‘several 
rating scale. The authors also 
fosin shat sain spite of taining sessions to increase interviewar 
reliability, the: agreemen bétween interviewers was onjy 28% on 
applicant's percept jon of medicine and 31% on personal appearance. *; 
. However, agreétherit was nor filer twice asin (73%)§ on re commendes. 
admissipns d&C# ion, oo e . 
In regression ana lyses of the predictors of ony grade. somake 
averages at at tutane , Haffman et al (1963) found that. the Personal 
‘Interview, Ratt ing, "a composite rating based on three pre-admission 


at interviews per taied by three member’ of the medical school peculys ’ 
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(p. 853) was: the“most consistent ‘predigtor in comparison. to the pre- Ay 


‘ dictors of age, MCAT scores and of Science and overal] -GPA. Although - 


the science predictors were better predictors of performance in the 

first ‘two years,.their predictability vanished for the last two years, 
while that: of the interview remained stable, though not especially high. 
Blumgart (1964)*also notes the limitations of the interview for _ 
obtaining information ¢ on factors related to redial students’ ac demic 
performance. 


a wl 


‘Attempts t to structure the interview and .increase ‘the reliability 


of the ,information acol lected have, focused. Zon ‘either specifying the™- 
_topics to be discussed with the interviewer’ or specifying, the traits © 
‘or attributes of the interviewee which -are to be rated. Motto and 


Werner (1965a) reported on their "continuing effort to identify | 
variables that are significant to thedical student performance patterns » 
beyond the second year ae are elicitable in an admissions’ interview" ™ 
(p. 899). They used “an interview outline of 233 questions about . 
personal background. as of inquiry include: study and learning. 
charactéristics; prior “@xposure to various aspects of meditine: and 


disease; perceptions of the family patterns of interaction; and perpep®:: Lae 


tions of parent, sibling, ‘faculty and peer characteristics. In as, as Re 
report on partial results of this &pproach (Motto, 1965), Sale itéms ere ks 


having to do with perceptions of Parents were able to discriminate’ “ 


amend stuOent= categorized by their performance in medical School « ge a 


In an ‘exploratory study,” Price et ae (1971), ‘analyzed tdpe- wfeconded 
We for the consigtency. withwhlel ee asked questions 
‘d to the same area. After sorting each question into seven broad 
categories, the results presented in table 4. 6 we btained. The. 
taped interviews wére also analyzed for: “four major tine: scores: 
"(1) Tength of pauses, (2) tim’ speat tasking questions, (3) time spent 
giving answers, and (4): time spent: giving additional information state- 
ments" (p. 27). As would be expected, “the self-consistency of each 


interviewer across his interviews was high, while as COSTS HENEY, - 
across eins « was not. ~ , 


L 


; agg (1975), however, investigated the reliability and waliaigy 
of 38 


ysician interviewers who interviewed 1,248 applicants to the °: 


_Untverséty of Missouri -Golumbia cover a two-year period and -concluded 
. that most of these ‘interviewers were both reliable and correct ih their. 


ratings. i, : ro _—s a Py 


: ole % 
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Gellmann and Steward (1975) found, by meatfe Of..an anonymous survey, 
that’ applicants rated’ the interviewing skis af me teal students: equal — 
to those of faculty members on.all ofthe cate garies considered. . 


Applicants reported a ‘high level of Sab isfact offewt h the student £ 
interviewers. ay, 


e 


& 


ry ; -_— TABLE 4.6 ~ zt 


Percent of Ques tions in Each Category Asked by Each Interviewer 


Question Category ; 7 , . Interviewer 

\ : ' I Il II Iv V VI- / 
: : ; 
Biographical Information 50.7° 50.6 {25.9 43.6 44.9 38.7 
Motivation-Interest 31.3 8.7 33.3 12.3 21.4 6.6 
Self-Insight ‘ 6.0 24.5 40.8 10.4 3.1 11.3 
Analysis-of-Others 1.5 3.9 
Reasoning and Speed of Learning © 18.7 1.0 
Technical Subjects P 11.6 19.4 37.7' 
Introduction and Termination 10.5 12.38 3.2 10.2 5.7 


Source: Price et al, 1971. 
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| ghances of being admitpad (32% 


 meWical school and 78% felt an att@mpt had been made to ascertain their . 
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That applicants feel general ly positive about the value of ‘the 
interview can be inferred from the results of a survey by Poorman 


'+..41975a) of the applicants to the Class of 1975 at the University of 
“I Kansas." Ninety-nine percent a felt that the interview had a proper 
. place in the cia tel rocess; 


2% felt the interviewers knew them 

better after the «intervf W; 62% felt thabsthe interview enhanced their 
we it had no effect and 6% felt it 

creased their chances). Furt 

re asked were relevant to whether they would: (yake a: good physician, 


% felt the questions were pertinent to prediction of their. success in 


mot\vation for ajmedical career. The existence of favorable -attitudes 
the admissions interview and toward,a psychiatric interview as” 
the admissions he was’ also shown 2 Gee (1957). 


me the Gijiabi lity: of the interview is the Simulated ae 
Admissions Exe¥g 


Prieto and Ke 
the major purp® 
sions committe® 
enables them t 
him or her as 
p. 13). While 


gek, 1974). Developed underjthe auspices ofthe. AAMC, 
ALof the SMAE is "to broa the .perspective of admis - 
Bmbers so that their interviewing follows a plan which 
Brceive qualities of the applicant that may identify 
iisort of person sought by the school” (Jarecky, 1974, 
mulation exercises with particular emphasis on 
minority studemm@me lection ar necessary for most medical school 
admission COmmIVgBe S because the‘ members of these committees may tend 
to eae ie all’ applicants’ through the prism of the White middle class 
value structure". (ibid.), their value pas tir htt over to the admission 
of al] appeegcants. "To the degree that ation assists admissions : 


a" 2,” i 


shouid belie i v i from .the interview progess and how that’data should 


x . : . b 


- The SMAE is eae: on mn the, view. that” for minority saplicents 
especially, many sources of data on thejr. qualifications for medical 


i cat 6, elarify admission objectives and to understand what data ~ 


rmore, 77% felt that the questions they 


e 


fa" 


Bse (SMAE) (D'Costa, Bashook, Elliott, es of th Leavell, 


school yield misleading and invalid information. The MCAT is considered 


culturally mee GPA is m¥sleading because’ some minority: group 
members, due lagk of reinforcement for academic accomplishments by 
the society at large, do ndt strive for achievement in this area. Even 
the information ee from the app hication form may be misleading: 


Aa? 4 0 


In wang respects, the app lication forms for Gey. 


medical school and the information transmitted - ® 
therein. as we]l a8 the assessment, of biographical 
“os data and of letters*of recommendation (al1 normal . 


a sources of noncognitive data) are established 
RS within the TTA MOE: “of the Readit tonal applicant. 
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Asasuch j they often are of limited value. in the 
assessment: of minority applicants. Further for 
students from other cultural bagkgrounds, the 
noncognitive variables themselves may take. on 
an: entirely different form. For an ‘inner/city 
‘BYack; demonstrated leadership may have fie as” 
a ember of a street gang, and for a Chicano ©. rd 
from New Mexijco, in church acetic. These: 
may never get included in a médical school 
application whichXasks for a’ list of college . 

*. rejated activities, expecting such responsés as. 
fratermity ‘president, homecoming chairman, and 
debating team member (Elliott\, 1974, p. 20). 


Because of the, importance -of the interview in the SMAE framework, 
it is advocated that; the interview and other noncognitive criteria 
come first in the admissions process, with the consideration of: 
cognitive criteria coming last. t 


What, then, are the types of information which should be sought © 
in the interview according to the SMAE? "The Simulated Minority 
Admissions Exercise does not advocate lower standards or second class 
status for minority students. Rather it advocates the use-of the most | 
appropriate, albeit nontraditional, information in selecting such 
applicants" (Sedlacek, 1974, p. 32). The nontraditional variables | 
proposed by the SMAE were derived from Sedlacek's work at the University 
of Maryland's Cultural Study Center and from the practical experiences 
of the SMAE author team.’ They are: "positive self ‘concept, under- 
standing and handling of racism, realistic self appraisal, preference 
for long range goals over immediate needs, availability of strong - 
support person, successful leadership experience, demonstrated’ com- 
munity service, and demonstrated medical interests" (ibid.). 


Simulation exercises are des igned to sensitize admissions inter- 
viewers to asking questions which would shed light on these areas. The 
specially constructed cases are based on 10 actua | nontraditional 
applicants and their application materials and interview responsés 
concerning family relationships; academic progréss; honors, interests, 
experiences; community service, leadership, racial perceptions; profes- 
sional gdals and career deye lopment ;_ and medical education readfhess. 

It 7s felt that the applicant's answers to questions on these topics WEA 
provide data for the non-traditional criteria. 


Ah evaluatiag of the SMAE (Bashook and Leavell, 1974) was. conducted 


* regarding the participants' increased sensitivity to non-~ ea 


variables. The data presented in Tables 4.7 and 4.8 show that (1) 
participants still relied quite heavily on the traditional criteria of 
GPA, MCAT scores and faculty letters of recommendation, though they did 
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"TABLE 4.7 7 AE ! 
. : , 3 . ~Y i 
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Ranking of Variables Used by SMAE Participants in Admission jon 


! gh og All f > : Ss i 
Variables Applicants re licant Cases 
Over- “MF JH LO GS an ae B FW UW 
all Mean | 1 2 3 4 9 10 
Rank Rank Ranking ce Cas 
Positive self- 2 2.4 2 3 2 2 1 2 fa Is 2 4 
concept i. ane | 
Z : ' P : “f y 
“Handling of 6 7.8 8 5 4 3 4 7) 5 he 6 8 
racism ; . of | 
Realistic it 5 7.3, 14 “6 3 8 7 3/ ali 3 7 
appraisal F | H 
Prefererice for. 77 8.1 1 7.0 9 9 @ 6) 7 12 14 
long range ; . 7 | H 
goals , 4 ! 
Availability of 13 + 10.0.7 13°14 '5 14 13. [5 4° 4 14 4 
strong support ; <e | eh 4 
person . 
Success ful 1, 4.8 nN 10 8 13 10 59 #2 6 7 IW 
leadership ; ¢ 
experience ° i 4 “ 
Deminsqrated .« 14° 10.9 5 4 13 WN M13 3 13 43 
commdn i ty , a 
service .o™ , ; 
Demons trated 7 ; j 7 
medical interest 8," 9.4 8 1) ‘9 6 8 10 10 #3 8.7) 
.- Premedical 4 5.) 6 5 4 7 3 8 2 2 5 9 
faculty rating . 
Grade point = 1, 7. 1,4 3 4 14 2 * Y + f 2 
average ' 
7 a : 
Medical College 3 4.4 4 2 7 4 4% 4 3 9 4 3 
Admission Test . » 
scores , a? a 
‘ a a Fe 2 
New Variables x. : a : 
‘ ' 4 ton : 
Extracurricular 9.5 8.8. ® 44m 1 5 1 9 ww 9 (Wo 
activities ae , 4 x 
Family ties and \ 9.5- 8.8 ° B 8 6 5 12° 12 7 Woo 5 
finance ao - 
Interviewers 12 8 7 9 12 13 6 13 11 #12 = «10 6 
assessment a Sooo 
Se 
Source: Bashook and Leavelt, 174. p. 76. om ae , 
a sos ¥ 
il v7 av” c 
a a 
x 
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‘Agreement of: SMAE Participants’ Ratings and Assigned Rati gs 


of Variables. for Applicant Cases) 
i 4 james 


. 
ry 


* Variables 


, 


\ 


Vs « 


Percent Acceptable# 


- , (N#130 
1. Positive self concept = * 66.2% 
2, Handling of,racism 52.3 
3. Realistic self appraisal | ° 41.9 
4. . Preference for long range . ve 55.0 
goals co — 
a 5. Availability of strong 67.7 
} support person ; / 
. » : G . 
6. Successful leadership 
4 P experience . ‘ 66.2 
7. Demonstrated community ee 4 61.2 
service - 
- 8. Demonstrated nedical 66.9 
BR \ interests - ; eo , 
, Average for Eight Noncognitive : ™ 3 : (59.7) 
Variables : 
9. Premedical faculty - Sy 7 3 60.3 
: i rating r So ‘ " 
, 10. Grade point average ; 79.4 
11.° Medical Colfege Admission ie 72.1 
Test scores ‘ , i 
’ + 4 x 
’ - Average for Three Cognitive o (70.6) 
: Variables : : R 
Average for 11 Variab rel no 62.6 


( & 3 


; . : 
> ' 


*An acceptable rating means that participant rating coincided with the 


authors' assigned rating of the 10 cases on the 11 variables. See 


“Table 1. = 


° ; ‘ . yy 


Source:’ Bashook and Leavell, 1974, p. 77. 
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at °, + *. « . oy 14 6 i se - 
show: increased selisitivity to some of the ngincognitive predictors, and 
(2) that participants generally rated the applicants (nigh, mote or 
low) on each, variable as had the’ SMAE autfors. oe . ? 
Obviously, there. exists, an “inferential jump _ ' 

between what a participant.says on paper or to work- 

~ushop staff and what he/she: does later as a member 
of an admissions ‘committee. At the present time, |. 
the only ‘evidende bridging this gap in information 
lies in the unsolicited follow up ‘requests by - 

participants to have their schoo]'s entire admis- 

- sions conmittee atten a future Simulated Minority: 
‘Admissions Exercise Workshop. After the initial 
Association ,of Amerigdn Medical Colleges-supported 

_ series of regional workshops ; each workshop a 
medical school ‘requests costs the school both money 

aye and ‘faculty time.. Not counting the regional ‘work - 

- shops, 20 medical schools of the 108 represented’ 
dt regional sessions have requested individual. . 
programs for their admission ‘committees . “Other 
special groups also have asked to participate, 
namely, the Mid-West Great Plains Déans, pre- . 

\ medical .advisofs, the Osteopathic dical School a 
Association, and the Veterinary Medital School 
Association.- It should be kept in’ mind that 

. requesting participation does, nae mean changing the 

_ admissions procedure at the schoo but rather, a 

willingness to explore a new aie to minority 
admissions. These requests’ for work shops may 

indicate -an initial, shift in attitudes and also a |. 
move toward a rational affirmative action program. 
Indeed, such action can have positive’ implications . foe 
for the entire admissions program. As one letter wie ns 

; . froma participant stated, the workshop “has beén . Htly 

; instrumental in admissions changes or different a 
approaches in several of the westem sciiools, not rr 
. only for minority but for all admissions" (ibid., _ m4 

» PP- 74-75). z ; ~ iy, ? 


Finally, . another approach to the training of admissions interviewers 
~ is reported: by Litton-Hawes, MacLean and Hines (1976). Five committe” ~ 
members (at Ohio State) interviewing in pairs were videotaped during 3 / 
admissions interviews and their verbal and nonverbal behavior evaluated. ~ 
Two common problems were identified: inefficien€ use of time and - 
reliance on the applicant's written file. Inefficient use of time was 
a consequence of asking detailed questions early in the interview and. 
thus. inhibiting responses to.broader, more general questions asked later 
on. Reliance on the written file resulted in (1) specific questions 
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-early in*the interview, : 35 ce 


‘tape has been requested and used by many universities throughout the . 
“United States and -several Torergn countries for the training of admis- “ 
Siorfs aE al (p. 4). 


ok | 1 


: i ; _ 


creased an contact which made: it more. ‘ 


difficult to establish ra\porttand ‘to -osenve nonverbal cues of the ; . 
applicant and: (3) concegerygs fog. quantttative criteria early inthe. \ 
intéryview which biased fhe’ sfiterv Peder so that he/she filtered subsequent r 
information. to hear. oni info ation- co firming his/her judgement . a 


“The authors: summariz Fectimendations to the admissions committee 
in: the form: of an instrécti ion yevideo tape. - Excerpts of the original 


- Yecordings were used in the’ tape to.illustrate specific problems and 


demonstrate seme of the more effective interviewing strategies. The 


“ if 


It is sbiieus from the research oh the interview which has been 


cited that there has been a good deal of effort devoted to improving its 


utility. Poorman (1975a) pointed out that 104 of the 109 schools pro- 


‘ ‘viding data: for. the 1975-76 edition of MSAR interviewed aT] of their 


‘as long.as admissions committees and applicants believe that the ‘inter- 


entrants,’ so ¥t is valued as a selection criteria. Nevertheless, he 
conc)uded that "The ‘validity of the interview remains obscure. However, 


view has a proper place in the medical school: admissions process, the 


Dhaai will be. continued" (p. 301). > 


Application Materials 


the tree types of application materials -- recommendations, 
applicant’ essays and biographic (as opposed to demographic) information 
— share with the interview the characteristic of ytelding highty 
variable types of specific information. from one applicant to the next. 
The characteristic which they do not ‘share with ‘the interview is that 
of having engendered a great deal of research devoted to their develop: 
ment and.refinement. While all are and have been’ an integral part of. . 


* the admi¢sions process7over the years, there has not been much effort ' 


expended on’ venhancing | their, utility for collecting that noncognitive 
information which has validity for predicting either medical schol or 
physician per formance . While the reason’ for this ‘lack of research 


. probably has roots in the Jack of any conclusiveness regarding, which . pe 


noncognitive facptrs are, mos related to performance, this would ‘also * 


‘ be true of the interview. Fu hermore, as was indicated in Table 4.5, 


the use by the Fourth Teaching Institute participants: of written 

evaluations, at least, equaléd that of the interview. Lack of research . 
interest’ #n applicant essays and biographic information is understand- . 
able as a reflection of the lesser use of PENSE items evidenced in the - 


same Institute’ data. : g 7 Gs 
pos The Tandiak® Fourth Teaching Institute (Gee aii Cowles, 1957) *3 = 
the most: od source of information on the use of splice i 


4% 


~ 


materials. Table 4.9 reproduces data’ from that report. which show that - 
recommendations from premedical advisors were considered especially 
valuable for assessing scholastic achievement, even though this might. 
Be equally well assessed through the GPA. It was considered almost;as 
“valuable$for thesassessment of scholastic potential, another assessment 
avat lable. through other sources, namely the MCAT. Thus, advisor's 
recommendations are particularly useful when the GPA or ‘MCAT do not give 
an accurate purine of an applicant ' S true pee 


The Findings of Richards and.Taylor (1961) are pertinent here. 

The premédical’.advisor’ ratings of 322 students admitted to the medical 
_ school at thé University of Utah from 1951 to 1957 were correlated with 
their undergraduate GPA's and ‘a coefficient of +.45 was obtained.’ The 
’ correlation. coefficients between premedical advisor ratings and medical 
=7 0! GPA's were: +,25 for first year, +.31 for the second. year and - 
+:03 for thé third year. The results suggest that advisor ratings are’ 

. reflective of an applicant's undergraduate achievement, but not very 
predibtive of. his/her medical school achievement. 
. Hy 

According to Table 4.9 the unique ‘value. of premedical advisors ' 
reports. for the Institute participants seems to’ have been in their 
asséssment of those indefinable traits, "character," "integrity" and 
"leadership qualities." Particularly noteworthy is their lack of value 
fér assessing "motivation for the study of medicine" and "suitability 
“as a ee physician. 7 ! 


ee “What may be. a more productive approach to recbmmendations is to 
have,.them written by the applicant's fellow students. At first glance; 
such’“recommendations seem open to charges of various sorts of bias, but 
Leape,“Palubinskas, Steindler, Wild and Dal rymp Té' (1976) recently * 
showed. these charges to be’ invalid, at least for® their saniple. 


One hundted thirty-seven ‘applicants to Tufts . 
University School, of Medicine from Tufts Uni ver- a 
Bo: sity and Princeton University were’ requested to ; 
4 pee the names of three fellow students who "you ' 
. fet| know you well.". Peers were then asked to 
ox fill out a confidential eyaluatign form which 
“ing was returned directly to prereset Commit- ° Pai 
A tee. : 
tee Peers were, asked to select statements con- 
Ff | cerning’ the candidate's dite ge for studying .° “nt 
. medicine’ and to rank himion a five-point scale | uid 
Pi ins Comparison with other ‘fol lege students re- i 
“se. garding 25 personality and character qualities. a 


2 They were asked to give comments as to major . = 
¢@ . Strergths. and weaknesses and tO predict the et 
. candidate ' Ss future’ s Success .asa Puy neren ; 


‘ ‘ ‘ 
= ‘ ¢ 2 
: oa a re 
2 : : BS 
7 ; v4 4 ° ‘ 
: ‘ Zz 5 : 
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‘ . * ee TABLE 4.9 
“ . COMMITTEE ESTIMATES OF VALUE OF PREMEDICAL ADVISORY 
. REPORTS IN APPRAISING APPLICANTS 
. (Conmittee members group) : : 
—————— re - 


/ % of 534 members citing value of premedical report | 


Applicant characteristic x _ Report 
‘ not ob- No u 
- «,; None Littte Some Much tained response 4 
yf 
Character , 1 9 52 33 2 3 . 
Integrity . ° ye ay 1 9 , §1 34 2 3 oad 
Motivation for the study of medicine 5 37 43 10 2 3 
Leadership qualities 1 13 48 31 3 4. 
Scholastic achievement» 0 3 ¥ 35 56 3 3 
Suitability as a potential physician 7? 36 43 9 2 3 
Scholastic potaptial | 0 9 51 33 3 4 
Comparison of applicant with other : ° : : , 
applicahts or with medical students 7 
from the same premedical college 2 8 36 46 5 3 
- Weakness and compensations, if any - 2 13 48 26 4 7 
Qver-all rating (highly recommended, . # P 
recommended with reservations, not > : 
‘ recommended } 1 5- 44 ‘ * 2, ‘ 
~ Other . 0° 0 cd g * u 9 
& . 
“Less than 1 percent response. ¢ 
7 Source: Gee and Cowles, 1957, p. 202. 
) TABLE 4.10 q e 
¢ . 
— 7 
\ MMITTEE ESTIMATES OF VALUE OF ESSAY AND/UR 
: AUTOBIOGRAPHY IN APPRAISING APPLICANTS 
“(Committee members sragp) . 
pane _ peace LB Ss 
—_—- a —— “ca = ———— 
' : & we ed 
3 of 371 *ete tinggig tue of essay and/or autoblography* 
Appraisal from essay and/or autob{ography . ee . F 
None = * Some Much No response 
as Ss 
me Sctaete = ® es 7 
Indication of applicant's profictency in , \ 
English composition and qrammar., 1 .5 - 4) 45 8 . 
r a Indication of sincerity of applwant® 4 33 36 19 8 
‘Check on motivation of applicant 5 42 36 10 . 8 
4 Appraisal of applicant's handwriting : 16 4 33 14 8 
a To help in the detection of abnormal . 
personalties 6 23 46 16 9 ~*~ 
: To yield information for use im subsequent _ . i at ‘ ’ 
7 interviews with applicant? ° 10 18 43. 19 10 
: Other 1 ) 1/ 3 95 


“Of the 534 committee members. this 69 per cent sald they used the essay and/or autobiography tn - 
appratsing applicants. Wo. 


a \ 
¥ 


Source: Gee and Cowles, 1957. p. 202. 
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“. . unwarranted given their expectation that “the Significant results 
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i } oe #4 
' Finally, peers indicated whether they too were 
premedical students applying to tures Duiveyorty 
School of Medi cine (p. 586). 

The ratings of: his/her three’ peers werePaveraged for each applicant .. 
on four scales: people-related characteristics, maturity, drive/ 
independence and predicted success. The scale scores were averaged into 
a Single composite score and "essay questions were analyzed for superla~ 
tives, negatives, . and extreme comments in the 'people-related' and 

‘maturity’ and 'drive' categories" (p. 587). 


The results showed several things. First, the method was well: a 
received, since 94% of peers coppleted the forms. Second, the evaluations 
were reliable, given that there was a wide range of scores on each scale, 
indicating that applicants were evaluated individually, and that the . 
ratings of premed peers ‘also, applying to Tufts were not Significantly © 
different from non-applicant* peers. eS the results were useful in 
discriminating among appli gants because of the wide. range of scores. 


‘The approximately normal ‘distribution of. scores also attests to their 
-validity, since one ‘would expect that such Characteristics would be 


normaly digtributed. Finally, the peer evaluation scores did not’ . 
correlate with GPA or with faculty recommendations, demonstrating that 


‘they provide i ae on the a not duplicated by other sources. 


Turning to the essay, -Table 4.10 shows that, aside from their value . 
as an “indication of applicant's proficiency in English composition and 


“grammar, applicant essays were regarded only -lukewarmly by Institute 


participants, having "little" to “some" ut+tity for assessing the © 
applicant's sincerity, motivation, handwriting and personality 
abnormalities. _ So f os 


In é study intended "to appraise : obgeceively the usefulness\ of the 
autobiographical sketch in the medical student's ‘application | as a\ 
predictor of subsequent scholastic performance" (Ho |me’s and Hertel,. 

1967, p. 269), predictions about a student's standing in the upper, :: 
middle or lower third after the first year were”made on the basis of* a 
reading of his/her application essay. When“compared with actual . 
standings, it was found that the predéctions wee considérably above the 
chance level (p = ,001).-. The authors felt that the results su gested . 


that the rater was relying on certain.elements in the essay which were 


not ;conscious to him. While they recognized that’ further stud ght 
identi fy What these elements Were, they considered the time and Sosts 
ould | 
not be, sustained for much time. This transciency would result from the 
essay's being an unstable predictor, “that is, one which applicants are 
capable of learning about, comprehending, and circumventing in ways in 


* which such unmani pul ative criteria as grade-point averages and MCAT 


scores are immune. This is not to be interpreted . as meaning that the 


oO 


106 as. 


ay 
. 
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autobiographical sketches should be abandoned as useless, but only to 
advise ‘that they provide essentially a 'fTtuid' sort of information 
which has optimal significance only at a certain time- and under certain 
rather immediate conditions" (ibid.). : 


x 


: if . vos Personality Tests 


*. t : : 

The third source of information on student characteristics in the 
noncognitive ,domain is that of structured personality tests. While the 
use of personality tests for the actual sefection of students is not 
very extensive, the use of unstructured or projective personality tests- 
for this purpose is even mgre limited. This was the case in 1956 
(witness the data from the Fourth Teaching Institute. presented in. 


_ Tables 4.5, 4.11 and 4.12) and continues to be the case. 
a aaa 


D'Costa and Schafer (1972) updated a survey by Schofield on non- | 
cognitive tests used in medical schools but did not distinguish between 
the use of’such tests for selection and the use of such tests for — 
research on already-admitted students. That the latter use is much the 

: greater becomes evident upon reading the literature on the persoptality. 

" assessment of medical students. Most researchers are practical people 
and,’ when suitable data are already available, will mich prefer to take 
advantage of such treasure than to expend their efforts and funds in 
the collection of new data. Most of the research studies On personality 
tests indicate that the personality assessment instruments in gdestion 


were administered after’.admission., usually to entering freshmen medical 
students. 


The Rorschach is one of the best-known projective personality tests 
in general use. Table 4.13 shows that only a handful of Institute 
participant$ reported having used or were planning to use either the 
group or the individual administration versions of this test. It is not 
listed by any of the .117 medical schools responding to the D'Costa and 
Schafer survey (Table 4.14), though two other projective tests, the 
Bender-Gestalt and the ,Thematic Apperception Test, were each listed as 


" used by 12 schools: ° ( 


. 


Among ther paabir dix advantages of projective tests are the amount of 
time necessary®o-admittister and score them, and’ the ‘difficulty of 
interpreting, the Wess1ts. Therefore, their primary use in medical 
school admissions hasgen for the weeding iout of applicants with 
personality brat 


ry 


#de the normal range; although Schofield (1957) 
points.~put “¢ t 2, ar a second possible use, to identify "from 
among thos®,whg, pass.the initial screen the ‘applicants who, are posi- 
tively endowed: with,@hiaracteristics significantly related tb a high 
level of gage 1 e" (p. 117). . . ; 
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be ; 4 
STUDENT REPORTS ON USE OF PSYCHOLOGICAL ; 
‘ TESTS OTHER THAN MCA ; : 
7 : (Hedical freshmen group) ; , 
ee ? 
: % of 756 ; 
Response freshmen *. i 
: fee oa cote en 
Other tests taken , 21 : 
Other tests not taken, 64 ; i 
Don’t know if other tests taken 1s 
a — 
‘ a. ; 
. Source: Gee and Cowles, 1957, 6. 208. , 
a . ° ba < : i 
f ? Fr m id - 
‘ " TABLE 4.12 Oy 
* La 
c < ° . . ’ . 
Pa ; SOURCES OF INFORMATION ON MENTAL HEALTH OF APPLICANTS 
, (Participants grou 
e J . 
= 3 ‘ 
Source of informatio % of 91 schools citing extent of use of source 
on mental health : ‘ ° 
to Hr? 
obtained None Little = Some Much response 
, I 
Appropriate questions on application form 41 6 14 25 2: 2. 
Persdgnal, interview’ 4 0 6 38 5] 1 *% 
* Psy@ jatric interv tow 38 1 ¢ 23 20 14 4 
Written essay by applicant 48 0 F 9 33 3 7 
Physitian's regort (non-psychiatric) 43 2 oy 24 16 6 
Psychological screening test 74 4 4 4 6 8 
Other 1 0 0 4. 6 89 EC 
° . sal “ . 
Source: Gee and Cowles, 1957, p. 204, ' : ; 
: lu 
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? x ns 
TABLE 4.13; 
. v ° oie 
a 7 PSYCHOLOGICAL -TESTS: PRESENT ANUP/PLARNED USE IN. EVALUATING 
: = : _NONINTELLECTUAL CHARACTERISTICS | vo 
. (Participants grdup) is ‘ ; 


t 


% of 91 pay ticipants indicating use of test - 


Tried and How 14 : Planning. Not planing = =—¢_. Noe 


3 : 
jame of test 
cua 


_ dropped suse _ to use _ to yse - :gtPSponse 
Strong Vocational Interest Blank ; 2 42 2. 52> 40. 
M{nnesota.Hultimhasic Personality ot , “, , 
_ Inventory .4 7 2 “$1 36 
. Individual. Rorschach 0 2 1, 56 4 
%, Group Rorschach, 6 0 . 1 56 : 377 Oe 
. Kuder Preference Record 2 2 1 sr: 40. 
.. | Comell Hedical Index 0 0 1 .F 59 40 
oS. Other 1 2. 5 2 90—Ci«, 
ae ; ; ’ : 
. ; : eo sft cy 
. ry ° : att ; - 
one Source: Ceithaml, 1957, p. 52. eo ge Od 2 . i. 8 ‘ 
ny a : Hef ° 
7 t A. ’ 
e -_ o 
8 
! *».. : 
ve. . rt ‘< . s \ 
s TABLE 4.14 ee 
: ; d ‘ : apes 
NUMBER OF SCHOOLS USING LISTED STANDARD INSTRUMENTS : 
7 ‘. 2 . Nymber of Schools 
Al tport-Vernon-l {ndzey Study of Values 18 é 
Bender-Gestalt (Projective Personality Test) 12. 
Calffornta Psychological Kaventory -(Gough) 13 ‘ "aie 8 
Cornell Medical Indexalealth Ques (Jonnaire ~ A 3. ‘ ‘ 
Edwards Personal Prefarénce Schedule . : : 16: ; ros 
Group Rorschach Test, ex * ‘ 3 / 
G3 Guflford’s Structufe: Of intellect Tests 9: a 1 . : . : 
a . , Human Figure Dranfog Techniques ee : 12 : a 
4 ' Kuder Preference <Recor’-Pecsonal aur. 4 ; 8 eres 
4 Minnesota Multiphasic Personality Inventory ae 32 oa 
Myers-Briggs Tybe Indicator > : , ,. 9. S 
_' Opinion, Attitudg, .and Interest Survey Jp, 2 aa 
Personality Researsit Form (Jéckson) iP hs oe fy Soa UF 
« Rokeach Open tied ‘Minded -- woe! ee | my 
Sixteen Pers@nad tty Factor Questtonnaire °" |. o 42, soe 
P S¥trong Vocational: intérest Blank , | a | 
: “Thematic Apperception, test a Be 1.7. 2 oN 
_ 8: oe i i a _ 
y Source: Q'Cogta“andéSchafer, 1972, p. 7. ieee mam 
» a : ee tefegy ‘ . 6 : ° ae : 
i “we, ae ‘ ee a. ar = ee 
. . eae . ‘ 
- : » as Ne . * a 
a 3 : | a eo a ? 
4s 4 s o . 3 * : 
yl 0 . - a 
em, Ne — - 
e . “4 ” ea - 
: : i 1 0 9 . Pad ‘ > 
ri 7 oe ee . “ 7 : 
- : aac a -- - AS 
a va : 
M2 7 Onn is s 7 = io 
“ — -~ rt ey , . 


to contra their resultant anxiety. 
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Faterson- (1956 ) indicated that a projective test ieee ‘in spuehiad 


“ psychopathological’ tendencies was being routinely given during the years — 


1950 to 1959 to those applicants to the State University. of New York 
Downstate Medical Center who were considered sufficiently promising to 

be invited for a personal interview. More than ten years later 

utility of the test (the Human Fi gure-Drawing Test) for the prediction 

of academic success or failure is examined and reported for the class of 
1963 (Faterson, Moldowski and Moldowski, 1969). Drawings categorized as 
"minus" were "poorly organized, faintly sketched, and lacking in” + 
detailing and in a systematic approach to the task" (p. 930), while 

those categorized as "plus" were "drawings which showed better overal] 
organization and appropriate detailing and gave an impression of a higher. 


* energy level (as shown, for example, in firm line pressure, ddequate 


size and assertive stance) " (ibid.). .Results showed that thé test 


successfully distinguished dropouts and repeaters from students” with 


regular progress (p < .001). © ? e ’ 
In order to show that students with "minus" drawings we re nat 

intellectually less able, the MCAT scores of students with -''plus" and 

with "minus" drawings were compared. While statistically significant 


. differences were obtained, their magnitude was relatively smai] and,. 


in the case of the Verbal subtest, students in the "minus" group 


_ scored higher. The authors went on to show that the personality test 
‘ was a better ‘predictor of academic outcome than was the MCAT. Of the 


four subtests, significant differences between academically successful 
and unsuccessful students were obtained only on the Verbal and * 


Quantitative subtests and, of these two sybtests, unsuccessful students 


scofed higher on- the Verbal subtest. than- ‘did. successful students. 
The. study by Lief et al. (1965), cited in .previous sections of this 
chapter, of the. characteristics of students ranked academically. hyghest 
and lowest. in their class at the end of the first year, reported | 
Rorschach data in, a general, prose description. . They indicated ' 


‘general trend for! the lower group to show more signs of Sibition and 
rigidity" (p. 117). However, the authors felt that the results could 4 


not unequivocally be interpreted as basic personality differences but 


_ rather should be pada a specific reaction to the Rorschach’ 


task for students aware of their low academic position and eteering n° 


tf fa) 


Structured eapsonntiey Tests And | OS 
Medical S¢hool Performance . . 


Two conclusions become evident from: reading the iptenatine on the”, 


- yelationships of personality tests to medical school admissions:’. 
- (1) that personality traits, as measured by structured tests, are of at 


least equal importance with cognitive qualities in predigting medical . 
school performance and (2) that structured personality tests, are less., 
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* time- consuming and costly than most other: techniques for measuring fy 
personality. traits ane are therefore more feasible for the admissjons ° 


process. | : ee ee a pe ee a 
The comparison is. essentially with tne interview and. isteanewor 
recommendation, since these are-‘the other sources of information 
directed ‘mainly toward evaluating the personality traits -o€ applicants. 
While these two techniques-may be said to measure "avlittle bit about .: | 
« a lot of things," what structured personality-tests do is focus’. -- — -. 
specifically on one or a few particular traits or concepts. When the ey 
particular traits or concepts are those which demonstrate ans : 
association with the criterion being predicted, whether: medical, school. . 
or physician performance, personality test scores pees te / 
results in prediction. aor : 

As a participant in the AAMC tonference én Personality ieecavencne ° 
in Medical Education, Jackson considers the implications for medical 
education of recent developments. in structured personality assessment ° 
(Haley, D'Costa and Schafer, 1971). Another participant, Snow, © 

, considered the interaction of personal characteristics and "medical- 
education treatments" or, in other words, medical schoal curricula ~ 
and teaching methods (ibid). 9 ey 
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One objection to personality testing in the admissions process is 

-- that voiced by Funkenstein (1957) that the stress experienced by the. — 
applicant distorts the results of any structured personal ity. test he/ - 
she might be required to take. ‘Therefore, altepnate uses of personality 
tests are proposed, including: (a) to test the cultural values which 
characterize the environment of a medical schoo] by examining student 
and faculty characteristics, and (b) i sensitize admissions committees | 
to their own unconscious biases. 

A study by Fields (1958 ) refutes the contention that, when 
personality tests are used in the admissions. process, their results are 
inaccurate, reflecting directly or indirectly the anxiety experienced by: 
the applicant. becauge of the evaluation to which he/she is being subjected. 
Fields simply readministered the Minnesota Multiphasic Personality 
Inventory (MMPI)-to a group of successful applicants immediately following 
their admission. By comparing the results to those obtained when the 
applicant was in the process.of being considered, he showed that there 

_ were no significant changes on the 10 clinical scales and only one of the 
three validity scales showed significant shift.. ) ‘ 

A researcher who has devoted many years to improving the prediction 
of medical school performance particularly through the use of personality 
tests, Gough is a University of California~Berkeley psychologist, who 
constructed two tests which appear frequently in the research literature: 
the California Psychological Inventory (CPI) and the Adjective Check 
List (ACL). One of. Gough's earlier forays into the selection literature 
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_ #was an overview of: studies /evaluating t redictive validity sf 

“ “7 * cognitive selectors (Goug |, Hal} and Harris, 1963) .. The conclusion 

.* was drawn that such crit ria are ‘inadequate and: other factlrs are 


\ 


\ Pan , a * ig r — ‘ 
Low 6... «This article was followed by one whith demonstrated the superiority. 
|. “eof the CPE over cognitive criteria for predicting\medical school .. 


. performance (Gough and Hall, 1964).." First, the CPT and MCAT scores ‘of 34. 


- ? more important. em : t 
a i f ty Nat : is 


a i 


.* > -gtudents entering the-Uhiversity7pf/Caltfornia-San Fréncisco Sc 001 of: 
Medicine in 1954 were compared with those of 66 rejected a pica. The 
only significant differences which appeared were on the CPI SociaNization 

# scale.and the MCAT-Quantitative subtest. The general, overall lack of - 
differences was taken by’ the authors as. evidence of the low weighting 
assigned to these two tests’ (CPI ahd MCAT) by the admissions. committee. 
The analysis then focuses on the accepted students. and on predicting | 
‘their yearly medical. -school GPA, overali GPA and faculty ratings on: ”’ 

« performance and-potentiality. These 6 criteria were corre ated with the 

3 predictors: “CPI,“MCAT afpremed GPA. F age e 


‘The: res ting- coefficients weré ale Tow and nonsignificant except 
’ for thoge between the CPI Sociability scale and third-year, fourth-year 
‘and gvérall ‘GPA which were significant at@ the -05:Jevel and between: - 
Sociability and faculty ratings, significaht at the .01 level. One 
wonders whether these result ointto the assignment of grades a8 a 
reflection of q,general “impresston of performance and potentiality by 4, 
* faculty~and whether that general impression is based, in.large part, on = 
the student's Tikeability.. This conjecture seems to be supported by the 
resdlts of the intercorrelations of the 6 criteria with the selves jn the 
present study. -All of these intercorrelations were signifidant except, 
that between first-year GPA/and faculty ratings and that between first-- 
-  year’and: fourth year GPA's. ~ ° A OS / > 


The study ‘then proceeded to derive two 'regress iongequations for each( 

of the 6 criteria, one of the 2 equations using the 4 MCAT scores as the . 
predictors and the’ other equation using 4 CPI scales -(Sociabfility, ‘ 
Tolerance, Communality and Status Potential) as the predjctors. The 

point of dpriving:these equations was to determine how much of the 
variationin the criterion was accounted for by: the. predictors included 

in the equation to the exclusion of other factors. Thus, two different 
predictjOns af each criterion could be made, one purely on the basis of 
weights’ for the MCAT and the other purely from the weights as$igned. for 

the CPI. The two sets Of "pure" prediction scores were then orrelated 
with the actual criteria to demonstrate which of the two predictors |(CPI 

or MCAT)-showed a greater relationship to the 6 diffenentecriteria.;,;The |. 
coefficients for the correlations between the CPI-predicted criterfa:and v 
*the actual crtteria ranged from +.49 (criterion - overall GPA) to +,66 

(criterion - faculty -ratings). The cpefficients for the correlations. 
between the MCAT-predicted and the actual criteria ranged in: absolute 
size from .06 (criterion - third year GPA) to only>.28 (criterion - first +. 
_year GPA). There was a negative relationship (-.18) between the MCAT~ : 
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“ The neil es were cross validated on another sample of San Francisco 
medical student seniors (n = 63) for which CPI correlated +.46 with 
fourth-year GPA (p< .01), while MCAT scales correlated +.03 to +.23 and 


* premed GPA correlated +.18. In.a final step, the authors employ the 


empirically-based CPI prediction-equation to derive profiles of high and 
low CPI scorers. The profile of the successful medical student is "one 
of rpreenaupet ik consideratiow of others, rather than. of need for 
-achievement, striVing, intellectuality, creativity-or personal aggrand- 
izement." °°. - oo 


fp Gough's other test, the Adjective Check List (ACL), is the. non- i 
‘F cognitive predictor in’a recent study (Gough and Hall, 1975b). The 


J 


study distinguishes academic. from clinical performance in medicad 
sQool through #he statistical factoring ‘of yearly grades and faculty 
ratings. The clinical performance’ factor, which, is the .larger compon- 
ent medical school performance, was essentially unpredictable from 
the MCAT and GPA, but was marginally. predictable from the ‘ACL... The 
MCAT and GPA accepéably predict the academic. performance. .factor. 


The operational definition of thé criterion in Gough's studies 


-" becomes progressively grosser over the years. He begins by using 


yearly GPA and faculty ratings, steps down to overall academic.vs. . 
clinical performance and then steps’ down again to graduation ve 
d\Hal}, 


, dropping out from medical school. In the, latter case (Gough an 


1925a), predictors from the MCA% GPA, interview, ACL and CPI sine hs 
correlated with the graduation/dropout criterion for 1,014 University , 
of California-San Francisco graduates, 40 non-academic dropouts and « aa: 
17 academic dropouts. ” 7 rr: 7 \ 
2 


Out of 49 predictor variables, significant coefficients were 
obtained for''MCAT-Quantitative, science GPA, last year GPA, ACL- 
Nurturance, Heterosexuality, Succorance, CPI-Responsibility, Sociali- 
zation, Communality and Femininity (for male subjects). The interview . 
rating did not correlate significantly with the graduation/dropping 

out hierarchy, but that which was evidenced was in the negative direc- 
tion” The authors reproduce the same type of regression analyses as 

in their 1964 study for each of the three groups of students: graduates, 


"academic and non-academic dropouts. The scores predicted from the 


4 


regression eel a significantly different between the groups. 
The best predicting equation was based on MCAT-Quantitative, last year 
GPA and CPI-Status, Socialization and Communality (a11 weighted. posi- 
tively) and*CPI-Achievement via Conformity: (weighted negatively). 


‘ 
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_ . Sity of, I]1inois-Chicago medical students’. 
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_ An autobiographical checklist constructed by -Beiser-and Allender’ 
(1964), which included: demographic and biographic variables, interests 
and career plans, was felt by the authors to distiaguish three person-~ 


ality types of medical students: “strivers", "individualists" and “un- . 


realists". Achievement was categorized into overachievemeht, high, 


* ,-average,. low and underachievement on the basis of MCAT - first year 


medical school GRA congruence or disparity. Forty-three percent (43%) 
of the unrealists were low~ or underachievers compared. to 21% of ; 
strivers and 16% of individualists. The gtudy is based. on 200 Univer-, 
Following up on these stu- 
dents three years later, the’ senior author (Beiser, 1967) shows that 
the threé types of students.tentinue in their different patterns of 


if r 


medical school achievement. 


. \ : - ms : - 
Using the Thurstone Temperament Schedule, as a measure of, drivé 


or motivation, in combination with MCAT scores, Morris (1958), success- 
fully preditted medical school achievéfent. In a subsequent, study’ 


(1971), three structured personality. tests were employed, #fie~Thurstone 


Temperament Schedule (TTS) ,’ the Edwards Personal Preference Schedulé 
(EPPS) and the Allport-Vernon Lindzey Study of. Values (AVL). The non- 
cognitive predictors were, related ‘to MCAT-Verbal and Quafititative 


and to “deviations of grades from those which would have been predicted 


‘by the two MCAT-scores separately" (p. 608). Morris summarized his © 
... Yesults as follows: = - < 


« 


1, - Need-exhibi tion and need-autbnomy of the - _ 2 


> as .°* 17 Edwards Persénal Preference Schedale 


variables were*significantly positively J 
related to achievement in.medica] school. 
Need-dchievement yielded: a low positive 
corretation with actual achievement at 

_' .the end of the first and second years and 

‘4 "* reached.a correlation significant at the 

7 5 per cent level with the students at the . 

end of four years of medical school.’ | 


2. There were no significant relationships 
between the Thurstone Temperament Schedule 
: .. variables and achievement, although the . 
: "Sociable" factor was consistently .nega-- 
oy -tively correlated with achievement. . , 


a 3. On the Allport-Vernon-Lindzey’ Study of 
a ».Walues, the "Aesthetic" value score ao 
’ ‘correlated positively and the "Religion" | °° ‘g 
vatue score correlated negatively with (.- >. 
Jachjevement. ea 


t 


“scores; to first year, second year and fourth year medical ‘school GPA's; . 


a 
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_4. Medical College Admissions Test Verbal 
Ability "Deviation" scores produced 

\ only one set of significant correhations 
with the nonintellectual factors. This ° 
was a negative correlation with the” 
Thurstone Temperament Schédule "Reflective" 
scale. This ‘suggests that as actual med- oe 
icalCgrades deviate from predicted “grades, 
there is a reverse relationship with the ~~ ot 
Thurstone Temperament Schedule "Reflective" 
score. Thus, over-achieving tends to be | 
ore ; related to the: type of person who likes to.. , 

deal with particular problems while the ‘ 

under-achieving person tends to "like med- 

itative and reflective thinking and enjoys 

‘dealing with theoretical rather ‘than pract- 

ical problems.’ 


5. Grades deviating fon predictions: based on 
Quantitative Ability scores were positively. 

: Yelated to the Edwards Personal Preference 
‘Schedule "Need-Exhibition" scalé and to the 
Allport-Vernon-Lindzey "Theoretical" value 
scale. These findings suggest that grades 
deviate. toward “over-achiévement" in persons 
who "like to say witty and clever things, . 
tell amusing jokes and -stories,...to be the 
center of attention,,..etc. They also sug- 

- gest a positive rélationship with scores . 
which characterize people whose interests 
"are empirical, critical’ and rational--whose 

. ° chief, aim in life is to order and systematize 
ne _ his knowledge." (pp. 609-610). . = 


ya 
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‘ 
Uther researchers have employed different single tests and ‘ 
varying assortments of several tests to predict different ‘criteria. 
Solkoff (1968) at the State University of New York-BuffaJo examined 
the ytility of a veritable grab-bag of, predictors -- MMPI, Group. . 
Rorschach, Wes }ey Rigidity Index, Stale of Social Responsibility, 
Eron's Humanitarianism and Cynicism Scales and the Authoriéarianism. 
Scale -- and concluded that none were sufficiently reliable to be used 
for actual selection. McDonald and Bynther (1963) found the EPPS and 
the Interpersonal Checklist (IPL) to correlate with academic achieve-. 
‘ment at the Medical College of South Carolina. Academic dropouts were 
significantly distinguished from the rest of their class at the Univ- 
~ ersity of Nebraska *Medicat Schoo] and’ nonacademic dropouts were shown 
to have an unique pattern of scores by the nee pve a a Examination 
(Wolpin and Garfield, 1960). 
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“Five factors:of-medieal school performance did-not correlate espec- 
- ially well with the: Stréng Vocational Interest. Blank and the 16 Person- 
ality Factor Inventory for University of Michigan medical students 
(Kelly, 19576). Barratt and White (1969). showed, that University of Texas- 

+ Galveston students with similar MCAT -scores but/ different -levels of anxiety 
»and impulsiveness’ (as measured by the IPAT Anxiety Scale and the Barratt 
‘Impulsiveness. Scale) had different. mean GPA's -in medical school’. -Alsoy’ 
included’'in this study as predictirs were the Guilford-Zimmerman Temp-| ” 

-erament Survey, the.16 Personality Factors Inventory,®*Barron's Ego . . 
Strength Scale, the Chyde Mood Scale and Plutchik's Emotions Profile Index. 
These latter predictors did not show significant relationships to medi- 

» Cal school achievement. — an . a ee 
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Rosinski (1963) developed a seven scale test.of the professional, — 
“ethical and intellectual attitudes of medical students. Testing two . 
years’ classes of freshmen and seniors at the Medical€ollege of Virginia, 
no differences between ‘the freshmen or the seniors were ‘found, showing! 
that the test was reliable, The author also found no differences be-, 
_ tween the freshmen and seniors and interpreted this as evidence of . 
the failure of the medical school .to;instill appropriate attitudes in. 
its students. . However, another interpretation, not considered by the 
author, is that .the attitudes.’measured.by.the test are too basic to be 
altered by only four years, of medical school.. If this latter possibility 
is true, it increases the valué:of the test for selection. 

‘ . Ina later study examining social class* differences on this same 
-+rattitude ifventory (Rosinski's Medical Student Attitude Inventory) and. 
other measures as well (EPPS, Miller Analogies, MCAT, NBME I and IT, 
and GPA), Dagenais and Rosinski (1975) found no differences in any of 
these measures except GPA: Lower Social class students had higher GPA's, 
a finding also. obtained by Gee (1958). The authors account for the homo- 
geneity of the student body as due to.anticipatory socialization and . 
the screening mechanism of the admissions process. 3 . 


Other studies employing structured personality tests are those 
by:Donovan, Salzman and Allen, 1970; Haley and Lérner,.1972; Haley, - 
~ Juan and Paiva, 1971; Haley and Paiva, 1969; Horowitz, 1964; Horowitz 
and Williams, 1964; Ingersoll and Graves, 1965; Johnson and Hutchins, 
1966; Mensh and Johnson, 1964; McCaulley, 1972, 1976b; Myers and 
McCaulley, 1973; Myers dnd Davis, 1964; Schofield ari Merwin, 1966. 


In the Karman, Stubblefield ahd Martin -(1968) study of correlates 
of five factors of performance at the University of Texas, Southeastern 
Medical -School previously cited in this chapter, the CPI, the Edward 
Personal Preference Schedule (EPPS), self-ratings of basic personality 
traits, gitems on a biographical inventory and faculty interview ratings 
were correlated with the five criterion scores. ‘Achievement in Clinical - 
Medicine showed no significant relationships to any of the nine CPI sub*. © 
scales or to- four,of the five EPPS subscales. ‘However, Achievement =~ 
score. on the EPPS was significantly correlated (at the .05 level) as was 
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the Self-Rating of Succorarice (r = -.24). Correlations with the 
other four:self-ratings of traits were not’significant. Biographic 
data indicating earlier school and home difficulties were signifjcant- . 
ly reJated. »However, MCAT GPA weregthe best and most consistent ~ 
predictors of me: Achi gvement in Clinic Medicine factor..“ ° Pht 

; The Weetnshi¢ Success factor | was not predicted by the a or... 
EPPS, but was related to Self-Rating of Affiliation (r = -.26) ‘and of ° 
Autoriomy, (r = +124) and te bjographic data indicating sociability. The ° : 
Nfeer Esteem factor was significantly and* negatively related to ‘eight of 


the nine CPI subscales but to none of the EPPS “subscales. It was neg-"-. 
“atively related to the single Sel€-Rating ‘of Achievepent, and to biographic. 


data indicating smail]-town origin, class officér, good barental ond home 
relations. : 


The Scientist Potential factor was related to the CPI scales of 
Achievement by Conformity, Achievement by Independence and Psychqlogicak 
Mindedness (all positively); to the EPPS scales of Dominance, NurtuFance, 
Deference and-Affiliation (the latter three negatively related); to Se us 
Ratings of Achiexement and of Exhibjtion; and to -biographic data repo 
ing urban origins,. father's education, not earning money early, “open 
disagreéments with parents" and "sickly as adolescent." MCAT and GPA 
generally . correlated-higher with. this.factor than did any gf the non- 
cognitive data. This is the only factor with which the eleven faculty 


i. interview ratings showed . any significant relationship. Seven’of the- 


eleven were related at, the .05 or .01 level. 


Humanism; the fifth Factor in this ecaerseneive study, was 


" extremely difficult to prédict, not correlating significantly with the ° 


CPI, the ‘EPPS, Self Ratings, MCAT, GPA, or facylty ratings from the — 4, 
interview. It was related, however, to biographical data indicating 4 
larger family size origins, rural background, ~lack of adWanced place-  ‘” 


‘ ment and good home and parental relations, which particularly encouraged 


independence. (Similar. types of biographic interview data relating to 
the psychology of family and parental relations were shown by Motto 
(1965) to distinguish between students with different patterns of medi- 
cal school performance) . 


A study which sunieved 60 scores from four personality tests and 
6 ability’scores to predict a factor of clinical performance was conducted 
by Turner, Hélper and Kriska (]974). The performance- factor was statist- 
, ically derived from ratings of videotapes of third year Ohio State medi- 
calyskills ‘in attending outpatients. Three ratings were made: communi- 
cation skills, interpersonal skil]s and skill in physical examination. 
The 60 preflictor scores were from four commonly used personality tests: 


the’ Opinion, Attitude and Interest Survey (OAIS),:the Omnibus Personality , 


Inventory (OPI), the Myers-Briggs Type Indicator. (MBTI) and-the 16 Per- 
- sonality: Factor Inventory (16 PF). Correlation coefficients significant 
at the .05.level were obtained for only five predictors (four of them 
personality predictors): 16 PF-emotional ly stable-(r = +.36): OPI- 
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anxiety level (r.=s-.29) an response bias (r = -.30); MBT I-judgment- . 
N perception (r= +.35) and store of the Physiology subtest of the 
NBME-Part I (yr ="+.29). MCAT-Science score correlated neggtively at 
: ' the .10 level of significatfce. she L 
>| . , . . 
. * Structured Personality Tests and — . ‘ ‘ 


Physician Pe rformance ; 

“The criterion of clinical peefoumnce used by Turner et at. (194) 
more closely resembles.actual physician, rath er than - medical a 
performance, even though the.study wwas based ‘on third year) medical ; 
‘students. As pointed out in the section of. this chapt aving to do_ : 
with cognitive seléotion factors, there are few studies relating 
admissions data to physician performance. es as the’ review iby 
“Barro (1973) shows, the asSessment of physician performance is ‘neither 
~pighly developgd nor frequent. D> a: Me 
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fy Tha: “Hesearch group at the’ ‘University of Utah headed -by- Price has. 
oe dévoted many years and much effort to eta, and identifying predictors 
Ae of’physician performance (Pyicé, et a}:, 1971) However, while predictors 
can based on biographic and demographic eee weire examined, .those : 
x ee by structured pers pal tests were not. ‘‘ 
he . ? 


dane The sole work in this” ‘grea seems to be that of Howell (1965, 1966) - 
{ ctted.earlier in connection with the MCAT. and GPA. ‘Her. study comparing 
USPHS physicians with ‘favorable and unfavorable supervisors’ ratings 
inéluded the California Psychological Inventory (CPI) and the Adjective 
Tac List (ACL). In summarizing Howell's, study, Gough (1967) reports: 


he 


oN Measures of achievement;and inteT- - 
Seas . lectual ability did not, differentiate —S 
: between the 2 groups, but a Vee humber of 3 
e ; personality test scores did distinguish . 
7 oar a between them, and«some of the differentiations 
* fs were’ highly significant. ; a co 


@ 


For example, on the CPI the men: with 
favorable comments ‘scored higher on scales 
for sense of well- -being, responsibility, 
_ ‘ self-control, tolerance, achievement via 
- conformance, and intellectual efficiency. 
. On the adjective check list..., used as 
es a self-report device, the physicians with 
a favorable comments scored higher on the | 
ait scales for self-control, personal adjustment, 
3 rae nurturance, affiliativeness, and deference; : 
} ee physicians described unfavorably scored higher RR 
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on the scdles for sejf-confidence, ]iability 
‘.-. dominance, autonomy, and agression. Other 
_ differences could be mentioned, but the pattern 
is.already apparent: © thé physicians who were 
. more highly esteemed by their superiors were 
_ - more adaptive, more self-disciplined, more+ ~ * 
_ cooperative, and, one feels compelled to add, ) 
more conventional (p. 648), 2 = 


In summary, the essence of a Pag tek alana the. selection ' - 
e following eleménts: the short- 

term criterion, medical school graduation, ahd the. long-term criterion, 
physician performance; Cognitive and noncognitive domains of applicant ° 
characteristics; MCAT, GPA, the interview, application materials and 
structured personaljty tests as techniques to assess applicant character-"' » 
istics. .The improvement of applicants' Cognitive qualifications and _— 
medical School responsiveness to societal needs for diversified physician 


* manpower "have currently (1). startedja.shift in the focus ofsselection 


from coghitivé to, hontogni tive “characteristics: (2) stimulated the dey- 
elapmerft of a new.testing ‘program (MCAAP) to assess cognitive abilities 
a Renewledgeg and.13)"stimulated efferts to better assess noncognitive 
chgnac teri stiase~ | 
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“CHAPTER V 
; & 
WEIGHTING OF SELECTION: FACTORS 
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There are two na dee approaches taken by Sanesions committees to ~ - 


’ the weighting of selection factors. These, approaches , which, may be term- 


ed implicit,and explicit, are reflected in two differing types ofs research 
in the areff of weighting. : 


Ca 


The implicit approach might also be called laissez-fairé since 
committee members are free to weight the application information avail= . 
able to them in any manner they deem appropriate. Research Oncéyned . ¢ 
with this approach has, therefore, been directed at post hod determination 
of the subjective weightings implicitly given by the committee to the ‘. 


‘ various factors. The primary statistical technique used in this type of* 


research, and Pach yeularty. suitable for the Purpose, is. that of ; on 

analysis. : , 

ae stich analyses the variation’‘in a criterion, whether a ranking 

of applicayits or a decision to. interview or to admit,’is broken down into 
separate components attributable to different sources or predictors. 

The importance of the vargance contributed by each predictor is deter- 

mined and reported as a weight. The analysis also weports a weight re- 
flecting the impor tance of factors not included in the analysis. This 
‘error term" in the regressidn equation will*refer not only to "noise" 

or ‘random sources of variance but also tp unknown relevant predfctors - 
not included as separate terms in the equatjon in their wn right. 

That these predictors have been excluded is usually due e a dack 


o 


‘of data. or to a foreknowledge of their relative Byinporeate 


- 
¢ ’ 


‘The other type of statistical analysis ised in ‘post hot studies 
of weighting is that of determining, for various séTection factors, the 
statistical significance of differences in accepted and’ rejecte 
appficants. If the differences are significant, it ‘indicates that 
admissions committees have been giving weight to those particular 
factors for which significant differences have been found. What such 
‘studiesdo fot yield are numerical indices of the amount of weight 


given to the various factors, such as are given in regression analytic 


studies. > ° : " a * 

° chadter VI focuses | on the literature having to do with phanges 
in the characteristics of rejected and accepted applicants as a’ way of © 
examining ‘changes in the weighting of characteristics and thus of .. & 
chahges ‘ih admissions policies. Actually a Majority of. the studies: _ 
reviewed in that chapter do not even test differences, but simply - 
report scores,, GPA's, etc. Furthermore, such studies of changes over - 
time “have not Senyaied the changes in weighting from.the real aoe. in 
the Chatacterts)) s of the applicant ‘pool. 
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The other major’ approach taken by admissions’ committees to .~ 
weighting selection factors is that of explicitly stating, prior to 
the decision-making step, the weights which the. committee wishes to 
assign. The weights are often applied through the use,of cutoff 
scores and are not as numerically precise as those obtained in‘‘post- 
hoc regression analyses of implicit wetghts. Research in this,area 
has usually been either (a) survey type, which.-asks: admissions per- | 
sons whether they considered the various criteria of* "much," "some" t 
or "little" importance or.(b) concerned with. recommending: or report-- 
ing cutoff points and particular combinations of sélection factors, 


. In the. case of survey type research ssl ht weighting, it* 
is important to point out that what the admissions person reports about 
his perception ofthe importance ofa particular selection factor may 
be quite different from the way he actually weighs that factor in com 
bination with other factors. Since the research on the€e types of 
explicit weighting approaches was a forerunner of that concerned with 
implicit weighting, let us consider 


‘ dat 


_ The survey conducted in connection with the 1956 AAMC Fourth 
Teaching Institute (Gee and Cowles, 1957) again is invaluable in pro- 
viding baseline data, here, on Institute participants' perceptions of —. a 
the importance of the various factors used in admissions... Table 4.5 ° ee 
presented these data. Table 5.1 supplements those data with information _ 
on stated and actual, institutional policy and refigcts the importance---"""*. 


or weight given to certain factors. That these are’factors involved in ~ 
screening applicants “seriously considered for admission" implies thatu.s: 


. there has been some type of first screening on the basis of other factors. 


Failure at another medical school, age, undergraduate grades, state of: 
residence and previous attendance at a professional school were factors 


of sufficient tmportance to the medical schoolsthat policy concerning 
their weighting existed at from 89% to 47% of -the institutions. 


‘at 150 representative institutions as .t6 their perceptions of the weights 7 


; : j es 
Hamberg, Swanson and Dohner 20 alr percaptios of advisors: 


and usefulness assigned to 17 pieces’ of adftisSigns data by admissions  / 
committees. The advisors' ratifigs were compared to the-ratings of ad-.-"". 
missions officers at 93 medicd] schools as to their own view of the ‘3 
weight and utility of the same pieces of information. Both groups rated 
overall GPA and science-math GPA "strongest" and most "useful." The: 


strong-weak continuum would be reflective of the weights given to the 
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« SCHOOL POLICY-ON FACTORS INVOLVED IN SCREENING APPLICANTS 
. , SERIOUSLY CONSIDEREO FOR ADMISSION 
A : se & . (Participants group) - F a + 
5 . ; ; ’ 
——_—_—_—_————————— 
Sof 91 schools stating policy concerning factor < 
: Influencing factor Publicly - ot stated . . 
. ‘ stated’ but existing - No No 
. policy practice policy response . 
A. Negstive consideration betause of Unusually old or ) . , 
young applicant: 18° 51 . 30 ] 
. > Paximum ‘age ‘ Y 35 40 14 
¢ ~ Kidimum age x 7 : - 25 48. - 20 
B. Sex of applicants: - er) 4° 33 42 
Men only; women only . Tr 2 68 + 23 
Percent of applicants of bach sex 2 8 53 _ ore 
: Percent of each sex enro) led : 3 10 50 37 
C. Marital status“ ° > “4 1 6 8) 12 
‘ a ae ‘ : 
, De U.S: citizenship preferred ‘ : ied 35 40. 16. 
ar, . E. U.S. citizenspip required 7% 9 6. 50. 35 
. 1 ipteptiy éonstjeration because of previous ; 
: attendance at professional schools: Rf 36 49 4 
Pharmacy - Je’ 16 74 2 
2 dees Dentistry Pe 8 18 77 ‘3 
e : _ Veterinary medicine 2 oe - 8, 130 “77 2. 
“ vt Osteopathy : 7 31 59 3 
Kursing (B.S. degree) ‘ . 6 : 13 79 2 
; F Graduate schog) ~ - 3 coe’ 4am 89 6 
oe 6. Premedical course of study: - 19, 3 64 4 
Specific premedical programs over and be yond 
stated premedical requirements are prefer a . ‘ 
| “H. Required minimum in college graces \ . * 33 %6 30 | 
I. Fatluré gt another medical’ $chool . oo 8B og 2 
J. State of permanent residence oT “4” qn 43 2 
K. ° ’ : 
' ; 1 13 84 2 
. 1 ARR a h is. . 8 5 76 ] 
3 Relatives of faculty ‘ 2 0 ¢ 7 . 80 } 
‘ _ 4. Students from selected collegés * | 3} 67 lo 
Source: Gee and Cowles, 1957, p. 201. ~ 
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ee, ‘The. two" groups were in very Gece. atireement..on. ‘14 of. ‘te We. 

pieces of data, but admjssibns officers: rated MCAT-Verbal, “MCAT-General 

-** Information and family Background as having: significantly. weaker wet ghts, 
.than did the advisors.» It is expected ‘that the admissions officers would — 


have more_accurate penceor Ione: of the actual, weights’ given to’the. varjous | 


factors. The ranking of the. factors they weighed. most heavily-was: 
overall. GPA,, science-math GPA, MGAT-Stiente, committee: letters, advisors". 
- lettérs, interview, MCAT- Quantitative ‘and professors’ letters J: However, 

almost equal. ratings were assigned’ to. these. ‘eight factors. The officers. 
weighted as weakest ethnic background,” fanti ly background and “other 
letters" (i.e. other than letters of recommendation or ‘letters from 
professors, committees or advisors). Weighted pyeaten as next weakest 
was the MCAT~-General Information subtest. 

2“ = 
In a somewhat-uns tructured questionnaire survey of the deans of 

112 U.S. medical schools (to which the admissions officers of only 48 
institutions responded) Haning, McDermott, Char ,and Hansen (1973) found _ 
almost uniform reliagce upon three sole parameters : GPA, MCAT and the 
interview. Attitudes toward letters of recommendation were mixed. Only 
3 schools used a structured personality test, -while one used. an intelli- 
gence test to supplement the MCAT (10° schools - expressing dissattsfaction 
with the MCAT's predictive capability). “Seven schools regarded the 
interview as of little or no importance, and one-does no interviews 
prior to admissions... Seven schools acknowledged the interview direct] 
as ‘very important’ in the selection process, regarding the importance 
of: the evaluation as equal to or greater than either GPA or MCAT... Ten 
respondents currently use some form. of algebraic formula to produce a 
score for each candidate, with variables for GPA, MCAT, age, personality 
traits (from the interview or supjective tests;etc.)... 25 of the 48 
respondents (52%) provide ‘work ‘sheets | with yarying data on the appli- 
cants to each committee member." Results of the survey also found a 
general lack. of structured interviewing procedures , "with several shining 
exceptions" and a general. inability to define the "good physician" in 
terms “other than those «af a good Boy Scout. _— : 

Another survey. of. explicit perceptions of weighting’ is that of 
* Mlott and Schachte- (1972) to which responses were received from 55 out 
of the 103 U:S. and Canadian médical schools which were surveyed.. The . 
results summarized ‘below provide -a. general impression of the relative 
weights given. to the vari ous criterta listed Lay the Ges ponceneas: 


. Thirty-eight: 6: tie '55 schools answering 
: is ‘question (69.1%) relied most heavily on 
grade. point. average, while 2 (3.6%) thought 
it of*minor” importance. Similarly, 38 schools 
'(69:1%) gave most weight. to’'Medical College. 
“Admission ‘Test scores, while 5 (9. 1%) considered 
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._ Conger, and Fitz (1963) report similar successful. results witlina 
"relatively simple, unweighted formula for preditting-success in medical 
_ school..., based on the number of admission variables on which an appli- 
cant’ fell in a so-called ‘danger range." (p. 947). The authors suggest 
that the advantage of using weighted rather than unweighted scores ° 
should ‘be examined. However, . since- "unweighted \scores" ‘are jn ‘actuality 
— scores which have been “equally weighted," what the authors are calling 
for is an investigation of the advantages of differentially weighted 
_ scores, ‘ 


Ambrosino and Brading (1973) report.on "an analytical computer- 
based methodology for screening medical school applicants" to the 
Albany Medical College. Their methodology involves simply the ‘computer 
‘calculation, rather than the. human calculation, of an average of ratings 
ye predictor variables, with "average" implying an equal weighting of © 

rs. The average is used to determine whether applicants will be' - 4 
invited for an interview, rejected outright..or held as marginal. 


» A system which differentially weights admissions factors at 
Marquette Medical School is reported by Rimm, Pazdral and Sine (1968). 
"The system weights undergraduate performance variables as follows: 
average Medical CoJlege Admission Test (MCAT) score, 40 percent; pre® 
medical grade-point average (GPA), 30 percent; undergraduate college, 

20 percent; and maturity ratio, 10 percent." The index of undergraduate 
performance which results is then used to "queue" applicants for an 
‘interview and/or other types of further’ consideration. - 


Another example of an explicit system for differentially weighting 
admissions factors is: that developed for selecting students for Florida 
State's Program in Medical Sciences (Elliott, 1975). Thé weights eo. 
employed in the Programmed Information Management System (PIMS“) model, 
both to combine factors and to categorize applicants on each factor, . 
reflect the commitment of the program "to select students with. a 
propensity for primary, care medicine, particularly for rural and inner 
city under-sérved areas, ‘and to increase opportunities for minority. 
students within the practice of medicine." The modeY gives 44% of the 
total weight to academic factors and 56% to nonacademic factors. Since 
the model is. not widely available and since it is the sole known example. _ 
of such a precisely-defined explicit weighting system, it has been:« 
reproduced, in Figure 5.1. es 


~ An extremely fruitful approach to establishing the weights which- . 
should be applied to admissions factors was .taken by Schofield and 
Merwin (1966). After examining the’ correlations between various pre- 
. dictors and the 2 criteria of first two years medical schoal GPA and of 
third year GPA, those predictors showing the greatest association with 
the criteria were entered into multiple correlation and regression. 
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| . PROGRAMSIN MEDICAL SCTENCES 


ae as ' a i PROGRAMMED INFORMATION MANAGEMENT SYSTEM ‘ 
ae on be "SELECTION: oDEL- a , 
1 . 16 . . a 
. “es ; ‘wv. 2 
_ B(GPA)2 + 4(MF)2 + aR” 4.252 + ans 202 + 2g? + 312 + X2 
DEFINITION OF VARIABLES: 9. os : A : 
GPA - Grade Point Average Formula “ ~ 6 
- MF - MCAT Formula (High School Placement Test Equivatency Formula) 
R= Faculty Recommendations F . 
* § = Soctoeconomic Rating . a , at 
G = - Demographic Rating 
7 M  - Myers Briggs Type Indicator Serts ing Scale . ue 
P D = Academic Distinctions a : 
7 Q  - Nonagademic Qualifications oe oa, -y 
u+ "1 = Interviews” ° ‘ a 
A - Discrepancy Evaluation (not int present use) “ . 
7 . . a 
= GPA --last three quarters (average) MINUS 
° GPA - ~ preceding three quarters (average 
+ GPA_ 5S 
dee & GPA verall : science + A gpa 
io 2 “3 ff, 
° Verbal + 2Quantitative + General Information + 2Science 
= -2 : 
MCAT = 10 J]. 300 
: . 6 ig 
e . Ata yg mi 
or . . "4 a a. i 
5.4(A'+ E +S) + 2(8.1 x N) + 2(8.1 x M ) , 
: s $ = 
rans . _ High School Placement Test = 10% : ~ 300 
a A = Aptitude E = English. S - Social Studies N 7 Natural Science M = Mathematics 
Faculty Recaririenda tions - , ‘ “2 f 
a SF : i ‘ 
; Rated on ‘a 1-5 scale by staff member in the Program-in Medical Sciences - 
Officdt Average of 3+ recommendations’ from junior college or unitersify. . - 
4 \ faculty. (Note~that .5 is Sub tracted from score far’ any,,recommenda tion Ree % 
cs missing. Minimum = 3) f 1 7 oe PA 
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"Aye Teitelbaum: ee and Rex (1973) describexthe erm and, imaiee ra 
mentation of ‘a. ; wititative system ‘of admissions" to the Col lege. of 
Hasan Medicine s# Mili chi gan State University in: which an Application 


‘Rating Form for each applicant is used. An administrative gtaff member 
_ rated each applicant on (1) GPA, (2) MCAT, (3) geographical origin, 
AM: Teve 1 of education, (5) MSU attendance, -(6) colleges 4ttended, 
academic honors, (8) extracurricular activities, to employment and 
(10) personal statement. | Other than indicating that ryfal ‘geographic. 
origin is given'a high. weighting, the weights or ways in which the 
various’ ‘data were rated are not explained. Applicants who receive 36 
points or more (out of a possible 65) are sent a second application form 
requesting letters of recommendation. (Those with scores of 31-35: are 
placed in. a, hold category. ) Thus, letters of recommendation, coming at 
the. second -levél of screening, carry more weight than4do the 10 items 
upon which the, initial screening is based, The MSU system also includes. . 
a third admissions stage in which those applicants surviving the second 
screening, which is based on letters of. recommendation and data-from the 
- ~ supplementary application. form, are interviewed. Again, by implication, 
"By the interview is given more weight than are letters of recommendation. 
<6 Those 90 applicants with the highest score based on all factors are 
v"* accepted. ee 


v 


This type of ‘composite weighting br t the: ‘various adini ssions factors 
was first proposed by Jopnson (1960).in an article describing an: 
"actuarial approach" to selecting students. . The predictive validities 

‘ of the single-selection factors of age, sex, marital status, years of 
dergraduate education, undergraduate major, premedical advisors' » 
ratings and interviewers' impressions were examined. It was then 
- shown that, by rating the applicant on a composite of his. scores in each 
aspect of selection, rather than weighting éach factor individually, a 
more accurate prediction of his/her probable success in medical alee 
* results. The importance of weighting t ‘applicant | Ss undergradudte grade 

‘ . record by the caliber of the institutiod attended is also noted, as is 
ithe value of using patterns of MCAT subscores to predict success in 
“medical school. By, hls 

A ‘subsequent article (Johnson: "1962)" peeked ‘on the utility of © 
an even nore sophisticated "multifactor method" for predicting medical 
scheo] completion. An ‘experimental rating. sheet, incorporating 10 
pieces of information was completed for 927° applicants interviewed for 
admission to the 1956-1960 entering classes of the State- University of 
New York-Syracuse Upstate Medical Center... The ten: separate factors © 
_were combined into a single index - ‘hased; on equal weightings of the - 

_ factors and it was shown that: the multi factor ‘index identified twice 


e° =" as a ratte Students: as did the single’ predictors wei ghted- ae 
by ho ; : > 4 
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is, considered advantageous.» "It seems:obvious that p 


9 
them least important. Interview data were rot 
. Sized by 28 schools (50.9%), and 2 schools (3. 6a) 
th t them negligible. Recommendations from ai" 
applicants’ former teachers were relied upon by 
22 schools (400%), and recommendations i . 
pre-medical advisorsewere considered very im 
portant by 20 schools (36.4%). Fifteen schools 
’ (27.3%) ‘deemed the applicant's motivation to- 
ward the study of medicine most important. A . 
total of 89 criteria were listed by the medical ,. 
schools answering this ques tion (p. 320). 


Reports on the admissions process at individual medical schools aoe 


‘also give a ae of the way’ in which selection factors are weighed, 


Marvin (1974) reports that, an application file for a student. applying fo 
to the pea of Arkansas Medical School is opened only upon Con-, = 
firmation of Arkansas residency, which can be interpreted as the highest 

possible weighting of this factor. Each member of the admissions committee 
rates the applicant ona seven-point scale after reviewing his file. The aw. 
ratings: »are averaged over committee members and the 121 with‘the highest - 9s 
average ratings are accepted and the next 15 to 25 are given alternate 

status. - The file contains 8 items: (1) AMCAS application form; (2) ” 

residency status form: and statement of the residency’ status committee's ~ : 
decision; (3) transcripts and certifications of degrees received; (4) |. 

MCAT scores and test dates; .(5) premedical evaluations from either or 
both individual faculty or ad: isory cémmitteés; (6) one or more’ 

medical school faculty evaluations; ,(7) MMPI results and resubts of-. 
psychiatric interview, if MMP I aids abnerma] ; and (8) “oeier 
letters of evaluation. > . 


at 
or 


- That both explicit and implicit weighting aye | carried on in the 
same. admission process is evident in the fact that each committee mem- — a a 
ber analyzes the file according to his/her own dictates, but “gertain + / 
factors seem to be. generally accepted." No negative selection ‘importance ; fie 


‘is given to'cotlege major, and financial resources are totally dis- 
regarded, while completion. of more than 3° years’ of opera! education 


ntal occupation 
or p#ofession, social status, ‘political. influence or amily status should 
be Yrrelevant factors iin judging the admissibility of applicants" 
(p.,85). The author makes a point which recurs throughout the medical 
school admissions literature: * “Dissatisfaction with the current sub- 
ordination of personal attributes ‘to grades as admission criteria has 


‘been smouldering for. some time-tn the minds of applicants, admissions 


officers, medical school faculty, and other interested and affected- 


persons" (p. 87). He notes: that MCAAP is presently attempting: to ‘solve 
the problem. ‘ 
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* Socioeconomic Rating 


Taken from McGuire-White, Index of Social Status - determi ned by’ ' 
P weighted values for, parent's occupation, source of incomé, and educati'‘on. 


Upper-Tower/Lower-middle class -5 
Lower-lower/Upper-middle-class --4 


» Upper class’ : -°3 
Demographic Rating ! 
~ FD A é % < € th 
. Rural, small town, inner city -'(9,999) + 5 
‘Large town - (49,999). - 4 
Smal] city: -, (99,999) ‘ - 3 2 
- Smaller metropolitan area, suburb, or _ : ' 
large’ metropolitan area + MBTA Sensing - 2° ; 
Smaller metropolitan area, suburb, or . : \ P oe 
; ® large metropolitan area without MBTI . ; 
‘ _ Sensing 4 aaa - J 


‘ 


mt Myers Briggs Type’ Indicator Sansing Scale 


Twenty-five points added to Mode? score for Sensing variable on the MBTI.- a 
_. > If not Sensing, add one point. . oe , 


2 
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Academic Distinctions =x ; — 
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Rated by a 1-5 scale on the Interview Report during or immediately after 
student interview. .Setection commPttee members determine variables to 
: be included in this category through iffformation included in the Bio- 
4 graphical Questionnaire as*well .as. during interview, i.e. 


: >. large number of hours 
% independent-honors =, 
: .  tnd&pendent study . a 
l : difficult courseload ' 
- honor societies aa 
easing GPA ; 


Ripa ; Nonacademic Qualifications — ha ee 
_ Rated by a 1-5 scale on the Interview Report during ar immedfately after’ ' 
is Student interview. Selection committee members determine variables to |, 
. + be included in this category. _ 4 
: - ai - us : z 


ott, eG . 
_ interviews 5 ° ; e 
Rated ‘on a 1-5 scale during or immediately after interview, Variables . ~ 
: be jncluded in this category are listed on'the Interview Report, 
.@, pe eg F . : 


t 


integrfty and maturity 


; : personality .. s a 
ae ___thotivation - eg ae ~~ 
ae 
Source: Elliott, 1975. , 7 
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analyses to” determine the weights which: would optimize their prediction. 
of.the criteria. "Thus, to maximize thé accuracy.of predictions of 
medical school grades for these groups,: the premedical academic péerform- - 
‘ance of the. student should be given relatively more consideration if | 
either personality or interest variables are deviant and relatively, less 
wetght if he achieves ‘favorable measures in these 2 areas" (pp. 506-507). 


. In a second phase of this study, the prédi ction equation$ developed’ 
in the first phage were cross-validated on another class of University *. ° 
- of Minnesota Medical School students. Contrary to norma] expectations 
ie of a "Sshrinkage"'in the correlation coefficients, the cross-validation 
coefficients were consistently slightly higher than the. original coef- ‘ 

_ ficients. we i a third and final phase of the study, ‘the equation- 

’ predicted performance ‘of a class of students was compared to their actual 
first-year performance. This was done for each of the- three groups ranked: 
by the admissions committee as high, Average arid low. No significant es 
differences were obtained. yiteed | *s 

\ he 4 

A later study by the senior author (Schofield, 1970) further \ 
validates the : prediction equations and demonstrates that "despite the 

. considerable amount of additional information (biographical data, 
‘references, etc.) available to the Committee,.its collective juggments 

. rested so heavily on academic characteristics that ‘the resulting selec- 
tions closely match those from-Pool C-which were based exclusively on an 
‘index i oay. the optimal statistical weighting of vee and MCAT 


scores (p. 741 
Best, Diekama, Fisher eal (1971) used stepwise mltiole:. 
regression techniques on 10 criteria and 14 predictors to derive pre- 

, diction equations. . "A recommended prediction equation...gives approxi- 
mately equal weight to premedical yrade-point average, type: of als ‘ 
attended, ‘quantitative MCAT score, and science MCAT" (p. 50). 

: i. conclyde that "precision of prediction is in no case ms y great ie 

- (ibid : 


Another approach to aeretninies the optimal ‘weights which should be 
explicitly applied to admissions factors is that of the "discriminant | 
.. function"” (Cullen, 1974). This: approach’ which is based on stepwise 
multiple regression: techniques, first.selects the pradictor having the 
highest correlation with the criterion, then that having the next. - 
highest correlation, etc. and determines the weights of those predictors. 


Milstein, Burrow, Wilkinson and Kessen: (1976) compare ‘the: accuracy 


of the discriminant model, which is:a linear approach, to .adécision tree cote 


model. for predictihg the- decision to. interview applicants. to the Yale ae 
_Sehool of Medicine. They demonstrate that "the two multivariate pro- ' 
eecures etal about egually well (approximately 77 percent correct 


r«) rs , i . | & , , : 
ERIC - - | | — 


‘<) 
ERIC 


lids _t * 


predictions overall for the clas# Re 1976 sample and 70 percent for the ' 


1977 replication)" (p. 632). Thétyee model (Sondquist's "Automatic 
‘Interaction Detect ah {AID) technique) is based on -the use of cut-off + 
scores as first p posed by Johnson. (1960, 1962) in his articles on 


~Mactuarial" and "multifactor" methods. “AID chooses an independent eee 


variable and:a splitting: value which ‘b@st predict the sample members'- 
scores:on the criterion variable (for example, intervieW/reject decision)" 
(p. 628), proceeding in-a simflar fashion with other variables or pre- 
dictors to subalidf previously obtained groupings. The. equation: with 

the weightings of the predictive factors men was obtained through the 
discriminant analysis is as follows: * 2 o aie 


~*~ 


"Y = .659 (GPA) + 649 (MCAT-Verbal) + 142 (vicar Quan tape. 
The tree model is reproduced in Figure 5.2. 


Weisman, Weinberg and Winstel (1972), demonstrate the construct fon. 
of another mathematical decision model into which can be plugged what- 
ever weights and factors are.desired as a reflection of the committee's 
philosophy. While this inuitive assignment of weights does not, acknowl- 
edge the work of those’such. as Schofteld who have attempted to determine 
the weights which optimally predict actual performance, the authors feel 
that the advantage of their model (and one can conclude by’ extrgpolation, 


"all mathematical models) is the uniformity of weighting for all ppp lls, 


cants which results. Independent of the weights they give*to various, 
factors, the authors contend that admissions committees fail to apply 
those weights uniformly due to a lack of frame of reference. There fore 
committee members yely too heavily. on MCAT scores and GPA. _A mathe- 
matical model would Shavide a-stable uniform application of weights. 
Jason (1972), in rebuttal to this study, strongly decries the use of such 
models, because he feels they will be used. to perpetuate the. overemphasis 
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Implicit: Weighting 
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Implicit weighting of selection factors ‘characterizes those admissions 


processes in which committees rely upon. their own intuitive weighting of: , 
the admissions information available to them to decide whether to ddmit - 


_ or reject an-applicant’.. Hbwever, implicit. we i ghting.-can also be an 


element in those admissions. procedures in which explicit numerical - 
‘formulae or models are used. Such procedures usually involve several 
phases of, Stages,,with implicit weighting usually occuring in the last 


tae -- i.e. the point where committee members make final admissions 


idecisions on a pool of. applicants culled from the larger total applicant 
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Bs 4 s 
AID prediction tree for outcomes of the first stage (screening) of w medical school admission 
procedure. Split-point) viluew for a variable are indicated on the uppersides of the branches 
extending front it. Outcome categories are encircled at the end of terminal branches. The number ~ 
of incorrect Predictions at these points is denoted by an asterisk. The number under the variable at. ° 
"the top of the tree indicates. the total n, and the distribution of cases in the tree is indi 
Pumbers on.the undersides of the branches.’ 
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. pho on the basis of the explicit formula or model. (The implementation _ 
~ s Of models is increasingly being accomplished through the use of computers 
as .destribed in Chapter II). — aa a , 
Research investigating implicit weighting is, by’definition, post. 
_ hoc in nature, attempting to determine the factors and their weights which 
_account for a series of.decisions or outcomes. The most efficient. and 
precise technique for determining the criteria and weights is regression | 
‘analysis. Bivariate correlational analysis will, in°’the present context, 
‘ be’ considered’ a ‘special case.of regression analysis; and while it does 
not yield weights, does.give an indication Of the degree of association 
' between a predictor and an admissions index-or outcome. . 


of-testing the statistical significance of differences between accepted 
~~: and rejected applicants. In such analyses, those factors for 2 oe 
‘which significant differences are found ate inferred to have been’ give , 
"more" weight than factors demonstrating little or no‘difference. The: 4 
-. problem with this type,of anal¥siss of course,.is that one cannot say 
_ precisely how much "more" weight these factors have been given. With 
‘ this framework of analytic techniques in. mind, ‘tet us consider the few 
Studies'in the literature which-have been concerned with implicit 
weighting in the admissions process. ~ 4 . 


, In contrast to regression/correlation is the inferential technique 


ind 


part of a large scale study, Carter, Chu, Koehler, Slighton and 
Williams (1974) examined, in an interim report, the process of student 
selection in a single, publicly supported medical school by theans of a 
regression analytic technique. Three separate analyses were carried 
out: (1) for 466 students entering in 1969, (2) for 172 minority 
students entering in 1974 and (3) for’818 nonminority students entering 
in 1972. The rationale for Partitioning the more recently entering 
class was that their admission was decided by two separate committees 
co ie they were selected by’"criteria that are said to be different" 
p. 28). Ei . 
oe - - 
ee. 
_ Fhe results: of the three analyses (the 3 prediction equations) were 
_ all, highly significant. (p<. .0001). They. show that, for the 1969 
entrants, the following predictors were all positively and highly 
(p < .01) related to admission: ‘sciencé GPA, nonscience GPA, state-_ 
residence and selectivity of undergraduate college. (They have been 
Yisted here in order of the degree of their relationship to admission, 
with science GPA showing the highest relationship.) Five other pre- 
dictors were also related to admission (p < .05): female, same under- 
graduate school, MCAT-Science, MCAT-Quantitatiye and MCAT-Verbal (female 
and MCAT~Science weighed negatively). : aa 
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For neither ‘the sinori or nonminoxity students entering in 1972" 


. were nonscience GPA, MCAT-Quantitative, female or same ‘undergraduate 


school weighted significantly, as they had been in'1969. Differences 
in the significance of. weights for minorities and for nonminorities 
were such that science hours and MCAT- Science were weighted significantly 
for minorities, but not for nonminorities. ere. MCAT-Verbal,. . a 
selectivity of undergraduate college.and state resi denice were weighted 
significantly for nonminorities, but not so for minorities. The. study _ 7 
further demonstrates the probability that ad hypothetical o Peg 
candidate with scores one-half. standard deviation ‘above the minority a} 
mean and evaluated by the nonminority. factors and weights would have a (, 
.0047 chance of being admitted. A nonminority candidate with scores one- * 
half deviation above the nonminority mean and evaluated by the minority 
equation would have. a .86 chance of being admitted. . The mega 
candidate evaluated on the minoritys+equation haga .53 chance admis- + 
sion, while the same nonminority caididate evaluated -by the -fionminority 
equation: has a 2057 chance. i 


¢ 


In a followup to this stwdy (Cooper, Lee and Williams, 1976), the 
same type of analysis is carri@Mout for the applicants accepted for 


‘admission at 10 representative ical schools for the years 1973 to 


1975. Prediction equations for each of’ the ten schools were derived for 
nonminority students for each year and, because of their small number, 
foe minority students for the ‘three’ years combined. A total of 40 
equations were derived. Again, the prediction equations were highly 
significant (p < .0001). By P 

General-gattems in the followup study results for nonminorities 
attest to ce cone ued and consistent heavy weighting of science GPA .— ? 
and the increasingly heavier weighting-of state-residence. -"The next 
most consistently significant variables in the prediction of the admis- 
sion outcomes are: being a graduate from the same undergraduate school, 
score jon science MCAT, and the quality of undergraduate school. atterided. 

spare highly correlated with each other as well as with 

the science GPA" (p. 43). The minority analysis demonstrated that, for 
9 of the 10 schools, science GPA is given significant positive weight © 
and, for 8 schools, so is MCAT-Science. Six schools gave-significant 
weight to state-residence; and nine schools gave significant positive 
weight to being: Black -Afro/Ameri can as pppesed p> ue a member of 
another pee BFOUP 


eee in on the factor oF States -residence, Rolph and Williams 
(1976) use the same ‘techniques to demonstrate that the effect of this 
factor varies from st&te to state, given the same applicant’ credentials. 
Taking the analysis one step further, the authors show that the strength 
of the state-residence effect is significantly related to the state's 
number of medical school places, physician-to-population ratio and per 


. Capita income. 
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Using a bivariate cerrelational approach, Calkins, Richards; 


“McCansé, Burgess and Willoughby (1974) evaluated an innovative procedure 


for selecting students for the six year BA/MD program at. the University 

of Missouri-Kansas’ City Schéol of Medicine, Eighteen predictors were © 
each correlated with a criterion, the "Council Index." Thé Council Index 
was the average of the ratings given to each applicant by the members ‘ 
of\the Council on Selection. The Council had no knowledge of the student's 


class rank, test scores, or chance of success. as predicted by the admis- 


Sions director and registrar (DAR). Separate correlation matrices were 


_ computed for the 162 applicants in 1972, the’241 applicants in 1973-and 


the 3§5 applicants in 1974. Significant correlations for all these years 
were obtained’ for the following factors: -nonacademic achievement, 
health-related job experience, class rank, admission test scores, 
reference ratings, DAR chance of ‘success, rating by a physician interviewer, 


recommended decision by physician interviewer, rating by nonphysician 


interviewer and recommended decision by nonphysician interviewer. The 
last four factors consistently had the highest correlations, indicating 
their. heavier weighting in the Couricil] Index. Race was significantly 
weighted in 1972. (discriminat ing against nonwhites) but was nonsignifi- 
cantly weighted in the opposite direction for 1973 and 1974. Sex was 
significantly weighted to discriminate agaigst females in 1973 and 1974. 


Using the inferential method of testing the significance of 
differences between 109 students accepted for admission at Michigan State ° 
University and 100 students randomly chosen from those who passed through 
an initial screening on. the basis of academic credentials but who were not 
invited to interview, Elstein and Teitelbaum (1974):examined 6 admissions 
factors. Significant t-values showed that the accepted and rejected 
students were'signifixantly different in their personal statements and 

in their "first screen points,” but similar on GPA, MCAT, academic honors 
and letters of recommendation. "First screen points" refer to-the sum of 
points on: GPA, MCAT, academic honors and personal statement. From these 
results it would seem that the personal statement makes: a crucial dif- 
ference for applicants since it is weighted highly by ‘itself and in 
combination with the measures of cognitive ability and achievement. 


Dresden, Collins and ‘Roesster (1975) ‘give a detailed report on the 
differences between accepted and rejected minority -and nonminority 
applicants to the Baylor School of Medicine in 1974. Because the numbers 


_ of blacks and Mexican-Americans ‘who applied and who were accepted were ‘ 
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almdst equal, differences are reported for three groups: nonminorities, 
blacks and Mexican-Americans. The number of acceptees were 132, 13 and 
14, respectively; while the number of rejectees were 220, 10 and 16, 
respectively, Differences on 2 cognitive criteria, 2 demographic vari- 
ables and 7 structured personality tests were reported. 
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mr - Generally. the results showed that cognitive criteria were used to 


a much greater extent in selecting nonminority students ‘than-in selecting |. 


minority students. On 59 noncognitive traits’as measured by the 7 tests, ."."." 


“12 and Mexican-Americans 18. Specif ly,. there: were significant dif- — 
- ferences between acceptées and rejec on all 4 of the MCAT subtests =° 
«for nonminority and Mexican-American applicants; there: were no signifi- © 
cant differences on the Quantitative and Science subtests Between black 
accepted and regected students. Cumulative, science jand non-science - 
“GPA's were significantly different within the nonminoifity group none of . 
‘ _ the three were different in the black: appljcants and gnly science GPA =~ | 
’ -, distinguished Mexican-American agcepted from rejected) students. . On most ~ 
: of the 7 MCAT and GPA indices, b 
Mexican-Americans, while the latter had lower mean scores thaw did the 
nonminorities.. — *% ‘ oe eg om 


nonminorities. showed only 5 * Sect differences, while blacks showed | 


2 


f 
+ Birth order showée.no “differencés-within the no inority and black 
groups, but did show differences among the Mexican-Americans, where the 
accepted tended to be, older than tifeir siblings. whilp those rejected 
tended to’ be amortg the syounger children in their family. Nonminority _ 
and Mexican-American acceptees were younger than thdse rejected in each. 
; of the two groups. ° Whéle there was little differende inf age between the 
two black ‘groups,.those blacks who were -accepted were, on the. average, 
more than 18 months older than” acceptees from the nonminority and Mexican- 
’ American groups. * ra ef 4s * = <6 = 


On nine scales of the Edwards Personal Preference Schedule, the 
- number of significant differences between accepted jand rejected ‘appli- 
cants was 3 for nonminorities, 4°for Mexican-Améfigans and’2 for blacks. 
- On 3 scales of the California Psychological Inventgry, the number of © 
differences was,1, 3 dnd-2, respectively. The Ego|Strength scales of 
the MMP’ showed no differences for nonminority or black applitcants,- but 
did yield ‘a significant difference between those Mexican-Americans who 
_were accepted and those who were .rejected. ‘The same results were 
obtained on the: Exgrevertion and Lie scales of the Eysenck Personality 
Inventory; .The-Kaptan Self-Derogation Scale sceres were significantly . 
‘. different,onTy between’ black accepted: and Tejected ‘applicants. Out.,of- 
/ , the 9 scates ofthe Birkman Attitudes Inventory, none were signj,ficant 
' different: betwee? the nonmipority groups, 2 were ‘nonsignificant’ fo: 


a Megiican Africans and 5 for blacks. Finally, on the 4 scales of the Beane 
a _ Birkman Vocational Interests test, nonminorities: and Mexfican-Americans . 


“,*shawed 1 signficant difference and blacks showed!3 diff@rences. | ‘ 
cara % aM ; - 4 % : . . . “' 7 * - ; eo 
Three, other studigs (Plagge., Sheverbilsh,. Smith| and Solomon, -1974; 
Pearse -and'Gorelik, 1975; Simon and Covell, 1975), reporting. on programs 

to admit. and retain increased numbers of minority st dents, support the 


acks-had lower mean Scorés than did the, +... 
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 derived:from the--Myers-Briggs Type Indicator -- the most relevant 


CHAPTER VI-~ 
“CHANGES IN THE CHARACTERISTICS OF = - of 


¥ r 


= ACCEPTED AND REJECTED APPLICANTS 


‘esl 


process from the’ formal-Togistics of applying to médical-$chool, to the | — 
weighting of criteria which goes. into detérmining fina] decisions. This: 
“chapter examines the.changes inthe characteristics.of those whom the 
ftissions process is desi gned-fo evaluate: the applicants. Three —* - 
“areas are examined: changes if intellectual Characteristics and. 
. academic background eehanges in personality charactéti sti cs; aig... - 
. €hanges in demogr. Wicacharacteristics., The fixst area deals with ‘MCAT: 
scores, undergradyatepBPA's, and the academic,#¥eparation of applicants. 
The“ section on personality characteristics deals primaril y with data: *. 


-Up-to this point we have examined all aspects of the admissions 


research found’pn this: subject.. The’ last, and most extensive area 
*AnclTudé's ‘information.‘on the changes: in socio-economic background, ~< ane 
geographic origins; Sex, race, and ‘ageofaccepted and rejected appli- © 
-.¢ants. The literature: exami ned for this’chapter ‘revealed’ varying 


“~~ 'degrees of change.within, each of ‘these areas. :The:‘amount of change 
'-. within each characteristic of accepted and rejected-;applicants’ may to. 


; ae various criteria\:(see Chapter V). In addit'’ 
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some extent be seen as # reflectionof change in the ‘weighting of —° - 
n 


TOn numerous “societal changes +e.’ ~ 


have effected. thé nature-oF the..applicant pool. 
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"Over the past. twenty years there has-been, much:.discussionof the’... °-- oe 
intellectual. caliber’ of medica} school applicants andenro}tees. a 


' Between 1955: and 1965 theré was considerable concern that, the average 

- applicant was less qualified: than in previous decades’. Other scientific 
fields were attracting large. numbers of the top college graduates in 
‘this era of aaah ee tte curriculuh of medical colleges a4 
became more demandjng -aM@et complex ‘requiring ‘a different type.of batk- - 
ground: preparation ‘fret ae ae, 
gates hy ee 


Suggested that the probitem Tay in the gap between :thé type of at ane 
specialized education that students were ‘how nédesving in “undergraduate” “AP 
. schools and the continually widening amoufit®” fF: iformation ‘they were. , 
fae expected to know,-ifi@dical. school. . "Thede:dé Hi ciendies. in, prepdratioa 

” wed a ae . 
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”"" ciinricula.of medical schools in a manner which would acknowledge the 
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“were in two mairi ‘areas: a) too specialized an education, and b) a lacks |. 


of certain fundaméntal skills -- chiefly reading and math" (p. 589). :. 
Moreover, “al though the entering medical students and the profes- 
sion itself have become more specialized, the medicad.,schools have not. 
They have responded. to the rapid terease in. knowledge not only by in- 
creasing the content. of the curriqula. but by adopting higher academic 
standards" (p. 590). Tioroblen\therefore was not a lack of capable 
applicants. Instead,° thre was*a need to enhance the appropriateness of 
“dn applicant's preparation. for medical school, as well as. to revise the 


differerit levels and types of entrant population (Funkenstein, 1962).. 


These types, of problems arise during what Funkenstein (1971) 
refers to as “transttional eras."- Mapping out the changes in medical 
education in this century, Funkenstein describes four distinct areas. 
The three of relévance here are: Specialty-Practice Era, 1940-1959; . - 
Scientific Era, 1959-1968; and the connie Era, 1968 - (at. the time 
of Funkenstein's report--1971--the Community Era’ was continuing), 
Drawing oh data from Harvard medical students, over“the past thirteen 
years, Furtkenstein analyzed the changes which’ occurréd. Students in the - 

«Scientific Era showed a marked improvement.in scientific training over © 
students in the previous era. Their scientific training was also far 
more specialized with a‘marked increase in the percentage of biology, 
chemistry. and physics majors, and a large decrease in premedical | 
majors. Going from the,Scientific Era to the Community Era, more 
students had had socdd}-science majors,. and thus tended to show a great 
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. deal of interest in -himan behavior, but science interests still remained 
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The applicant studies published each year by’the AAMC also bear out - 3%" 
this -contention. They show that since 1955 ‘the average MCAT scores for ' 
both accepted and rejected applicants have been: sTowly but steadily’ _ 
rising (see Table 6.1). ; : ae oe 
Before turning to the data derived from Table 6.1, it should be 
“noted that MCAT scores for applicants are much,narrower thah they 
"© would be for the general population. This is due in part to the self- 

: selection which occurs in the application process, Many factors come. 
into play which cause: the total applicant pool to be of overall high 
quality and the differences between accepted and rejected applicants are. 
sometimes not very great (McGuire, 1972). For example, the widespread | 
knowledge of the competitiveness of medical school admission may cause" 
many individudls with poor or only moderate academic credentials ‘to. 
refrain from applying. Culver (197#) reported how, with no knowledge of 
the MCAT scores of one year's applicants, ithe: admissions committee at 
Harvard admitted a class whose MCAT distribution differed little from 
that of classes accepted in years when applicants’ scores were known, 


_.'s In spite of the above mentioned. qualification, a. close examination 
of the data in. Table 6.1 yields some interesting information oh the - 
changes -in MCAT scores of accepted and rejected applicants over the 
past twenty years, First of all, for each five year interval one. can 
see that, while the differences between séores of rejected versus 
accepted applicants never exceeds 84 points, it is more than. one half 
standard deviation in each.case. (MCAT ‘scores are Standardized on the 
basis- of, a mean score of 500 and a ‘standard. deviation of, 100.) Moreover, 
between’ 1955-56 and 1975-76 the increase in Scores for accepted ‘students 
:., on, the Quantitative Ability and Science subscales approaches one standard 
:,, deviatton (the differences being 92 and 93 points respectively). It is Mo 
. > Interesting to’ note’ that. the avérage MCAT scores for rgpecesd applicants ~ 
- in 1975-76 are higher thar}: tha comparable scores for -56 accepted 
applicants for uantitatiyeAbiTity and Science and are &lmost e same 
for Verbal Ability. ee 3 pH 


For the five time perigds-in Table 6.1 the averagé score di‘fferen- 
tial' (between accepted and rejected applicants) is 71 points on the 
Quantitative Ability section and 74.points on the Science section. (the . 
two sections which generally carry the most weight in admisfions 
decisions). Therefore, whi le.-the -rang# of scdres for applicants. to - - fe 

: dical school may be narrower than. in the. general ‘populatfon; -cléarly 
pre range in scores has allowed some differentiation in the quality ‘of: . 
applicants. . = ‘ a oe ; 


the annual education issues of J.A.M.A. provide additional inf@rma-— 
tion on the changes in applicant: characteristics over the years, 
_ Although these ‘data pertain only to. accepted applicants, several fnter- 
“esting trends are apparént.. First ofall, there was little change in 
‘the percentages of entering students with grade point averages (GPA's) 
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. Nean MCAT ‘Scores of Accepted and Rejected ‘Applicants 


: at Of Quanti- - General’ ° 
First-Year Verba) - tative Informa-. 


id 
Class + Ability =| Ability tion Sciences, 
} eg = . , “ oe a 
oe os)" $UACCEPTED APPLICANTS i - 


1955-56 | Se 524 = "4? Ga 527 
1960-61, °° 627 °° 693 527 
1965-66 541 °°, *5830 565 
1970-71 + - 559° 606. “"*,- = 560 
1975-76 - BS os} 620.7%. 550. 
: "4° REJEGTED APPLICANTS |’ 
1955-56 466 we 459 . 476 | 
1960-61 464 453 473 ; 
1965 -66 ' 473005 - 502 BY 
1970-71" 506 ° ¢' 539 © | +518 
1975-76 * | $22 562 x . ,.513 


* 


2 . DIFFERENCES BETWEEN ACCEPTED ‘AND ‘REJECTED 
1955-56 BBS 69 a) 6 


1960-61 _ 63 - "80 54. 8 “s 
1965 -66 68. 81 - ,. 5A 83 
1970-71 »  §3- 67 « - 42. 59 
1975-76 ; 530 ~ SB. ek BD — «6 
Average’ - 59 7 or 48 rr a 
_Source: AAMC Yearly Applicant Studies. 
“sade ' 
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* 
of A, Borc . dujing the period 1955 - 1964. (Table 6. 2). But again, there 
was substantial change in the following ten years (1965-1974) with an 
increasing proportion of students receiving A's and a decreasing pro- 
portion receiving C's. However, it is difficult to ascertain how much - 
of this increase is due to grade inflation.over the past ten years, and . 
how much is actually due to an improvement ms Be eat iber a 
applicants. ; Oe os a ; 
7 
The formal educational background of scented applicants has aise’ 
increased ' somewhat over the past twenty years. In 1955-56, 75 percent | 
had four years of college education and 70 percent of this group pos- od 
sessed baccaluareate degrees. Ten years later, the proportion of . ad a 
.enrolled*students who had completed four years of undév'graduate 7 : 
- education ‘was up to 83 percent, and 90 percent had done: So ‘in 1974- BS. 
(AMA, Education. Issues of J.A.M.A:, 1955- -1975). : 


co. In ‘fecent years some "coneveversy has ‘arisen over the differences“in .— 
ye ary criteria of accepted. minority students and accepted white ~~” 

students (Davis, 1976; Cooper, :1976). .Table 6.3: indicates that- currently. 
differences in the undergraduate grade point averages..and mean MCAT... 
scores of Caucasian and Afro-American appTieants do: exist.: However, - 
admissions committees do not base théir decisions solely on. the basis of - 
these two criteria. Rather, a wide range of non-cognitive criteria ome 

into play (as distussed in Chapter IV); dnd the. more aspects of an. 
applicant's background which are "non-traditdonal" the less weight is 
placed on "traditional" criteria. This by-fio means indicates that - 
minority applicants who are accepted aré ‘less qualified” ‘overal] than 
thelr. non- minority counterparts. Sedlacek: (1974) explains that: . 


_ Recent research: indicates’ that, for minority students, 
ae ~ Inany of the traditional predictors are-not optimal - 
ae _. indicators of how they will perform at a higher * ae 
ee ga. F Tevel of education... .. The term "nontradigional"):::~ 
ee refers to a unique variable or to a somewhat, dif-" °°” 
. ferent use of a traditional prdédictor. It is: 
‘ Jmportant that such’ nontraditional criteria not be 
‘ viewed. as. inferior or deficient. Minority, applicants 
often come from’ a background which is culturally.. 
different and about which a typical. admission com- 
mittee’knows relatively little. To. use traditional 
predictors with-such students would be to. overlook 
the potential. for medicine that they have shown in 
terms of their own culture. (p. 317 


overal Mit is clear that the test scores and GPA's of medical ‘sGhool - 
* applicants have improved since 1955, with the credentials of both “ 
. © accepted and rejected applicants. of recent years becoming more impressive - , 
“2. than those of their predecessors. With ‘the exception of the controversy 
over the quali fications Ot some ‘accepted ees, the 
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Comparative Analysis of College Records" 
of First-Year Medical Students 

- . in Classes eaterlng 1955 through 1974 
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Applicants By ° 
Self Description 


Black /Afro-Ameri can 
fe « Accepted ‘ 


“"Non-Accepted a 


ae an 


Accepted 
-"Nori-Accepted 


je" Sayre AAMC, Division of Student Studies, 1976. 
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a. admissions committees of toy need be considerably less concerned’ out 


“the, cognitive qualifications/of applicants than--they were ten or twenty 
“years: ago... Because the applicant ‘pool of goday includes am abundant 
number * “of” students with acceptable MCAT scores‘and GPA's, admissions 
committees can now give more attention to noncognittye., era teria. 
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Numerous edi disquss the potential. utilization of persbnality 
measurements as a criteria for selecting medical students’ (seé Chapter 
IV). Several studies describe the results of t ese tests on already- 


admitted students at indiyidua}schools. For example, Donovan, 


‘Saltzman and Allen (19704 anaTyzed the results of the administration of 
the Allport-Vernon-Lindzey Study of Values (A.V.L.), and the Edwards 
Personal Preference Schedule (E.P.P..S.) to eight successive classes of 
students over a six year period (1964-1969).:.at the University of 
Rochester School of Medicine and Dentistry. They found that entering - 
classes showed -considerable homogeneity from one year*to the next. 

The attritton study by. Johnson and Hutchins (1966 on medical 

school dropouts, ‘presents national data on the. A.V.L., E.P.P.S., and 

_ Strong Vocatiof&al Interest Blank of the 2,812' students in the AAMC . 
Longitudinal Study who entered medical schook 1956. Other reports 
criticize the-admissions system for paying too tuch atténtion to cogni-.., 
tive criteria and ngé enough to the personality characteristics of 


“However, in attempting to specifically address the" ‘issue of changes : 


over time in the. personality characteristics OP BCes DEES and rejected 
applicants” ‘one..is faced with a paucity of: ‘information. . Aside from 
Funkenstein's. resedrch on the eras.of medical education : ‘{see,earlier 
discussion in this chapter), only the research conducted’ ‘with the 


myers Brass Type Indicator pertain: directly to this ye = 


McCaul ley (1976b), ‘of the. Ceriter of Appi cations - Of: Psycholdgteat - 
Type, “has recently compared her own research to that of Myers which was 


_done,in the early ¥950's, though not reported. until later (Myers - and Davis, » 


1964) «. Both studies used the Myers -Briggs Type’ Indicator to assess the, 
distribution of” Bevcnoloai=a) es among medical, students. The. thesis 
_,i5 that "certain; habits of mi operationally defined.’ ‘by the Indicator, 
‘2predi spose a person to find certain activities satisfying’and to choose 
a a expected to, Provide such activities” ae Davis, 1964, 
See wh 


The "preferences" which ard measured on’ foiit cont init and: the’, ‘5 
opposing endpoints of each continuum are described as: . ‘. he 


» . ae ee ae 
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I. Sensing: Interest in facts, details, the-tan- 7 fe 
ys gible and immediate. - . 


‘Intuition: Interest “in possibilities, meanings, 
a relationships, imagination. — 


; 4 - a J 
II. Thinking: Interest in the analytical, imper- 
sonal, logical, cause-and-effect. 

vs. . Oe! eae 
Feeling: Interest in the personal, in what 
r . © : matters to people. |: “ . 
. Il}. £&xtroversion: Interest in variety, sociability, db : 
ne i action, involvement. a r 


: a : : fs se 
Introversion::. Interest in concepts and ideas, 
-' “s.getting deeply into. probleris. 


IV Adudging attitude: | ‘Interest : in: order, system 
Mies ue a7 planning, schedule, .. . 


‘ - — “Perceptive attitude: Inferest in spontaneity, = * 


pow 


flexibility,..curious for 
change. (McGaulley, 1976b, 


pp. 1-2) - 


thy 


“*  MeCaulley's, findings (1976b) “Show a clear majority of the Intuitive 
type over the Sensing type, while in’the hye data of the.]950's the ° 
.-. proportign was almost-equal. The balance between inkingfand Feeling : 
' types was almost equal for both time peyiods... This-is log}¢al consider- 
. ing medicine's need for both scientific and humanistic judgement. — . aoe 
" Similarly, data from both studies show an ‘equal balance of Extroverts and.” 
Introverts. The ratio between Judging and Perceptive typels , -however,.: 4: 
has reversed itself with a higher proportion of today's. students being... 
Judging types. Bt ee Sth Re co 
—a These ‘changes are nateworthy because it would ‘seem that Sérising and 
‘y. _ Perceptive types are those most likely to be itserested in primary car 
_., Specialties.. The data from McCaulley's research compares her results . 
with those of Myers for both pre-hedical students and medical students. -~ 
The comparison demonstrates that scarcity of Sensing/Perceptive types , - 
eexists in: both pdépulations.. It would appear that the escalating competi- 
* .tiveness: of medical school admissions is filling the applicant pdol with oc. 
more ,of the students who, because’ of their psychological type, perform’ =»! 
- * ‘best academically arid'on tests: ‘i.e. the Intuitive, Judging. type. ‘This 
‘«, Imbalance’ can bé at least partTally rectified eye) delta te interview 
tO assess those qualities which a “indicative Of each type and by 


>: &b) balancing the membership of admissions committees as to psychological 
eo a e it &, | 145, : : ' 
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—— type. The reasoning Behan this second proposal is that committee - 
members are subconsciously more ‘likely to, recognize as. assets -those’ 
traits and Ene teyenses which they’ thertse ves possess. 


“McCaul ley, ‘agreeing with the viewpoint of Funkenstata (1970) and 
Perera (1966), among others, fee's that heterogeneity is most desirable 
& in madical student populations since meee is a highly diversified 
field.’ ; ( 


wa + 4 Fs 
‘Demographic Characteristics 
Sie 


‘socio “ECONOMIC BACKGROUND a3 
In 1965 Rosinski_ wrote that "although both intelectual and non- 
intellectual faculties of medical students have béen, studied, . social 
i ¢lass has been neglected.".~Indeed, there is a surprising lack of data 
on the subje throughout the past twenty years. ‘However, that which 
is available 1 dicates that the social classes of American society -have 
ieee disproportionate ly’ ney een ‘in medical student, populations. 


In ‘Rosinski's research; a Pepresentative Semnté on ‘American medical 


s 


schools was used. The students of four ."types" of medical schools were poe 
an 


é ‘examined, with: their social class -being attributed to father.'s. education 
' -, afd occupation. It was found that “inlall the schools ‘a Surprisingly ; 
small percentage of studénts came fro 
yet more than.50 pertent of ‘the total U.S. Population, are. represehted , 
by these categories. The converse is true for the upper social clas$3" 
34 percent of the,'students came. from this class. -and: yet this*class con- 
stitutes only 3 percent of the total U.S. population’. "... .It was also noted 


that 7 of the four representative schools,’ the one with: ‘the lewest tui tion . 


athe highest ;parcentage’ of students from the two lower social classes. 


Ta <a Fein and Weber’ (1971) ‘reporting national, data. for 1959, 1963 and . 
—" 1967. Sea that - Vis. imbalance: in the representation of social _ 
classes has chian little over the years. Drawthg.on data. collected by - 


~ — -NIH atid AAMC in J 57 -68,. they report, that: "though only 34 percent of all 


Anérican. fami Ties reported incomes ‘over $10,000 in 1967, 63 percent of . 
all medical students..reported that they came from families with income 
over $10,000. Conversely, though 25 percent of all Ameritan families 


earned Jess than, $5,000, only 9 percent of all medical students came = 


- from such fami lias" ene 
t 


“Moreover; the. edugation and occupation of the fichers of reavea: 


_ students place them in the upper social: classes. For example,’ the per- — 


- Centage ‘of students with physician fathers has been di sproportionately 
+ Targe. over the past twenty years (Johnson and Hutchins, 1966). It should 
ae a noted, ‘however, that these students have been ae eae ‘to 


the two loyest social classes and.” 


- 
- gutal 
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‘ their representation in-the applicant pool (Supplementary TabTes to 
;. - Dubé Johnson, 1974). Stmilay data-collected in the, 1970's (Johnson 
-:  19758}show a continuation of these patterns. - te ia 
Fein and Weber (1971) pointed out that "even though it is clear 
that, on the average, medical students come from the, highest socio- —— 
economic groups, there is considerable variation in the Socio-economic ~ 
status of. students attending the various medical schools" (p. 103). 
This coincides with the findings in Rosinski's study(1965) and lends 


further support to the causal relationship between tuition level, and. ae 
‘socio-economic background Of students. . Supplementary data from AAMC's “" 
"last three applicant studies (Dubé and Johnson, 1974,-1975a, 1975b) ° 
_ indicate that, in recent years at least, there has not been much dif- 
' ference in the percent’ ofgaccepted versus rejected students in each 
< income level. This isin spite of the fact that MCAT scores and GPA's — 
‘increase somewhat from one income bracket..to the next. No. similar data ° 
are available for previous years as of this writing,.°. , © ef 


GEOGRAPHIC ORIGINS 

_, In recent years attention has increasingly been drawn to the need 

for more physécians in rural areas (Colwill, 1973; Colwill, 1976; "yA 
. O'Brien and -Bagby, 1975; Applied Management Sciences, 1976; Aaron, 
-«  1976a), The yearly education issues of J.A.M.A. -have also pointed to a . ° 
. continuing geographic. maldistribution of medical students and physicians 

over the past twenty: years. . However, there dre. little concrete data on 


_. " the rural/urban distribution of students. + 


ae Since the association has been drawn numerous times (see references ' +. 
"+ above) between a medical student's geographic background and his/her 
eventual practice location, much attention has been directed towards 9. : |; 
increasing the number of applicants: from-rural backgrounds. Information: ,...%°! 
collected by the AAMC (1975b)- indicate that many, if not mostyymédical =: 
schools are attempting to correct geaqgraphic imbalances in theirsstudent 


bodies. . a, ’ a ; 
a ol pe fe nn : 
Colwi 11/1976) reports on efforts of the University of Missouri-. A 
folumbia School of Medicine to: "reflect the overall demographic patterns ° ; 
of the stata in the. medichl class, thus, providing a somewhat higher » —~ 
perceritage of students with rural backgrounds than might otherwise occur." { 


fru and Will (1973) reported on a Micces stu program in ~ 
Illinois which sedks out capable students from doctor-needy rural Areas ge 
and recommends them to ‘the University of I]linois medical’ school. ine a 
return for either a recommndation (which guarantees admission), or 

financial assistance (up to $6,,000. ver a four year perigdy ac both, the 
applicants agree. to practice: in a needy community. -(Seé Chapter’ IV for 
a more coniplete discussion of this program, ) - - 
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g the number of applicants from small communities as a sole solution 

to geographic maldistribution. Schwartz and Cantwell.-(1976), reporting - 
on data from the most recent Weiskotten Survey, state that, "survey... 
respondents, like the population as a whole, who cathe from! the smallest 
towns and those of 25,000° and léss, have migrated to cities of 25,000 

or more" (p. 535). For example, of a sample of 4,996 physicians, only 
16.2 percent of those who-ware reared in communities of less than 

10,000 are now practicing in that size compunity; 44.3 percent are 
practicing in communities of 100,000 or more; while the remaining 39.6 
pereent are working in communities of-+0 ,000 to 99,999. . 


~ A variety of other programs have been, or are being developed in 
many: schools (AAMC, 1975b), which focus on a wider range of solutions 
than simply the recruitment,.of rural applicants. These endeavors may 
ensure a regional ‘distribution of applicants and future‘physicians more - 


responsive to She country's need for medical services. 


Rolph and Wiliams (1976) give a striking demonstration of the 
effect an applicant's state of residence can have on his admission to 
medical school. Citing J.A.M.A. data on U.S. medical schools, they 
found an apparent.intrease in recent years in the preference given by 
both public and private medical schools to applicants from their home’ 


‘ state (see Table 6.4), Possible causes of this widéspread phenomenon / 
are cited as ranging From state political considerations, to physician | 


ere 


. 


gr: “+, 


" 


see : 


; a However, this study also found'that “tabulating:the.acceptance’. ~... 


hortage concerns',;ito changes in the patterns. of applicants. * 


ce eee 


there may “be other differences between applicants frm:the various 
states which would lead to spurious conclusions. Foy.example, about . 
37% of the nonminority applicants from New York and North Dakota were : 
-admitted*to some medical school. But the applicants from North Dakota 
all came from undergraduate colleges at the low end of the selectivity 
scale while applicants from New York mostly came from more selective | 
undeygraduate colleges" (Rolph and Williams, 1976, pp. 9-10). Control- 
ling for "eg sustarttal ad applicants' backgrounds, they found that 


success. by applicant's state of residence alone js Nbthe because 


there was "a substantial advantage in. being -from North Dakota rather 
than New York when applying for medical school admissions". (p.-10). 


“ The effect of state residence, according tO Rolph.and Williams, | 
varies greatly by state. No statistically significant’ relationship 
was..found between'the state of residence and the .ratio of either public |. 
or private medical school; pJaces per 1,000 population. .."Thfs suggests- 
that. differences in policies across’ schools is much more “important in’ 
explaining state-to-state differences in:admissions odds~¢han the: 
‘number of medical school places located in the state”. (pi,g2). 
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There is some question, however, as to the fruitfulness of increas-- -~ ©. 
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NUMBER AND -PERCENT. OF STATE 1 RESIDENTS ENROLLED N° 
ou <P FIRST-YEAR CLASS BY PUBLIC AND PRIVATE MEDICAL SCHO LS, 
2 , 1969-1970 Through 1974- -1975 “rn 
-, Public Schools “Private Schools — 
Year -" Number tt .Number Percent. 
— 1969-1370 4,935 i 
1970-1971 5,466: -* 
1971-1972 . 6,011! 
3 1972-1973 ' @5676 : a 
re . 19731974 4, 082 
. _ 97687 7,778 93° 10,921. 76 , : 
Harvard, George Washington, ; ‘ 
information. ‘ 
. 7 
-. ne 
“Source: J.A.M.A., December 29, 1975, ‘p. 1339. + 
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- considered a masculine domain, From 1065-1965, only _ 


. numbérs of women may in the future consider medicine as 


“brought on rather dramatic increasés ‘in’ female appli 


_.-tion in any federal ly funded’ education program. ‘* 


: their small numbers in ‘the, applicant- pool. (caused .by a multitudé of tiny: 


bow 


/ 


.,RACIAL/ETHNIC IDENTITY =” .F he 


* 
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Up until the’ 1970's, the role. ‘of¢Peystcian was, fi the most part,-#. 
y, Mpde'st increases “0 ™ 
‘were seen in the numbers of female ‘applicants. and accebtees (T4l¢.6..5). 
In 1966, AAMC reported that, "women are manifesting an: increasing: ” 
interest in medicine by increasing their numbers as both medical $chool _ ae 
applicants and as medical school graduates. With the growing: shortages ti we 
of medical personnel and the increasing roles in medicine compatible se 
with the accepted roles-imposed on women by our. cultuxe, eyen' greater oe ee 

.a-careéer" (AAMC, 

Div. of Operational Studies, 1966 , p. 164). Indeed they.did. Changes 
in sociétal attitudes towards appropriate: roles for..wamen::and: changes in 
the perceptions of women themselves. regarding career, opportunities: 


‘entale ants and enrollees. ,-- 
(Table 6.5. adapted from ‘Dubé, 19764)... -Dubé‘aiso attributes!part of these 
changes’ to‘the:.passage of federal “tegistation prohibiting sex discrimina- 


+ 


As seen in Tabfe 6.6, the enrollment of women from all minarity 
groups increased by 1,954 (115 percent). from 1971-72 to 1975-76 
libtd., ps 693). . These gains are also impressive when analyzed for 
individual ethnic/racial; minority groups (Table 6.6). . ee 


The ratio of accepted to rejected female applicants has been an 


roughly equal-to.that of tales over the ‘past twenty years. ‘Thus, ttie* 
small ‘number of enrolled women might possibly be more a reflectidn’ of 


factors not dipectly:related:in amy way to the admissions“process) than. eae 
a reflection of- discriminatory policies of admjssions committees. . 
oe | ef %: ae 

Since the literaturé--does not contain any mention of programs to 
recru¥t more women, the recent upsurge in female applicants appears to 
Nave been caused by general societal trends (Carter ‘et al., 1974) rather - 
than direct intervention in the admissions process. For whatever “7 
‘reasons though,-it appears likely that the representation of women in { 
medical schools’ will continue to increase (Dubé, 1976b). 


a. 


‘Since the laté” 1960'S, ‘much attention has been focuséd- on increasing 


“ethe number of minority appli¢ants and"enrollees. Unlike the’ situation ab 


for fanale applicants, dig¢rimination: against minorities unfortunately 
did exist within the san@cions Process. for many decades. In 1955 a. _.». 
number’ ef schools stil] would not. admit Afro-American applicants (Raup Pe. 
and Williams, 1964). As for other minority groups (Aferican Indian$, "ie 
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Schools Applicants No. Percent Acceptees Munber “Women AN] Acceptess 
; 7 Applicants i 
1955-56 82 14,937 1,002 6.7 7,969 a a 50.3 ° 6,3 
1960-61 86 14,397 1,044 7.2 8,560 600 7:55. *% 9 7.0 
1965-66 . 88 » 18,703 1,676 9.0 9,012, 799 any 8.9 
. * . * ar ¥ . ’ 
1970-71 103 24,987 2,744 10.9 11,500 1 +297 Cy. Sn V3 
1975-76" 116 42,238 «9,563 «s «226 #18176 3;603 aa. BT, 
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8 Mexican Amp cins and Ma hand Puerto Ricans), no data were uncovered 

*.- forthe pertod, priofto 1968 which:would reveal how many were applying 

“oto re dics pence |, or ,hoy, many were accepted (Manly, 197]a). ~~ eo 
“fs ca ay es x ee : . ; . . AES © 


“ in] - onge Bé fore: the ’T9720"s, the majority of black médical students were 
.. enrolleg at Howard; and Wéharry (Raup-and,Williams,,.1964). In 1968-69, 
“sous, these “two institugTons enrolled about 63; percent of all black wave 
” §2" tedical ‘students*jn the U.S. By’ 1974-72"the proportion was down to. +, 
« “27 percent, AMA, 1972) an Jin 1974-75 it had further:dropped’ to 20°, 
 percent:(derived. a j 
‘> J, refléct. a“de€lining number of black medical students: at’ Howard and 


a 


rom MSAR, 1975). This trend does:not, of tourse,  «°"*"- 


' Meharry, but. rather an increase in the nunber. of slack students enrolled . 


aS 


at predominantly white $chools..s° =... . Bg ; 


_ In 1985-56,. only 2.6’ percent (Raup and Willjams, 1964) of al] medical 


* _- $ghool ehrallments were composed of black studenf§... Little change had 
‘ " occurred by 1969-71 when the proportion: was at_2.8 percent (Nelson et 
. 21., 1970). The 1975-76 enrollment figures show: ah incréase, with §.2 
-. percent of the medical student population self-identified as Afrao-_ 
"American. .-(In order to be consistent, enrollment figures have been’ 
“ "used here since application figures by race were not available for 
1955-56.) Table 6.7 demonstrates the racial/ethnic breakdown of the 


* .” $975 ~-76 applicants and acceptees. Unfortunately, comparable figures do . 


not exist. for this extensive a deJineation in earlier periods... ak 
re - . a ae : Jo oe 


s.. Made’ tg do so (AAMC yearly Applicant’ Studies; Hutchins et al., 1967;° 

a Elliottg 1969a; Jarecky, 1969; Johnson, 1969; Nelson et al., 1970; . 

" - Gardner’et al., 1972; Blue Spruce, 1972; Buxbaum, 1972; Ramsay, 1973; 
Student Natigna® Medical Association, 1974; DHEW, 1974; Thompson;. 1974; 
Carter et ak:, 1974; D'Costa et al., 1974; D'Costa and Prieto, 1974; 
Johnson et al., 1975; ‘Pearce and ;GorelTck , 1975; Gaines, 1975; Henig, 
1976b.. These reports concerh efforts by individual schools as weal as 


Programs prapo sed for national implementation. Even a cursory examina- 


ition of this" literature ‘indicates the complexity of the situation and 
.thé problems involved. Many, if not most, of the roblens appear 
_ prior to admission’. For example, as Henig (1976b) reports: | : 
; Some see the major problem in the ‘minority education business' not 
ifr admitting minority students but in encouraging them to apply in the 
+ .fiyst place" (p. 29). Factors which discourage minority students from 
* -.applying include lack of role models, inferior educational backgrounds, 
lack of financial resources, and sometimes, the misinformation that 
a ‘medical schog] admissions is still racially discriminatory. 


a ‘*, - This’ last factor (misinformation conterning discrimination} is 


, . especially erroneous judging from studies such as that of Carter et al. ” 


, (1974) - They “ that of the nif schools in-their sample, minority 
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increase minority ‘representation in medical schools, and about efforts -- 


ae” ‘Total : 
: Black/Afro-Ameri can 
“Ameri can Indian 
"¢ White/Caucasian 
“ Wextcan Ane rican 
: gir tent 21/434 an-Arer ican 
Puerto Rican (Mainland) 
Puerto Rican (Commonwealth) 
Cuban 
: * . ; Other 
~ +, iy No Response 
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TABLE, 6.7 


. Accepted 
| 2 


15,365" 100.00 
948 6.15 
57, 0.37 

12,985 - 94.51 

220° 1.43 
3872.52 

80.56 
1040.68 
60° 0.39 
265 (1,72 


1.67 


Source: AAMC, Oivision of Student Studies, 1976. 
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26,938 + 100.00 
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75 0.28 
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8271.01 
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1,158 ° 2.74 
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applicants received strong preference for the classes entering in’1972.- 
Reverse discrimination suits in recent years (O'Neil, 1976) have . 
.. Strongly discouraged: preferential admissions: for minorities. However, 


as explained earlier, the selection criteria used by admissions commit- 
tees are usually broad enough to allow for differences in the back-., 


“ grounds of applicants. -And; as Sedlacek (1974) pointed out, the use: 


of non-traditional criteria does. not imply a lowering of standards. 
Therefore, while minority applicants may not be given preferential 


. treatment, they are no ‘longer faced with dystiimination in the admissions . 


process... ante Tee Cae 
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I The age of accepted and rejected applicants has varied little in the 
past twenty years. The average age of accepted applicants has remained 
between 20-25, with the heaviest .céncentration in the 21-23 range 


older applicants: 1) the dropout, rate of applicants increases with 
age (Johnson: and Hutchins, 1966); and 2) the long-years of training 
involved in becoming a physician. limit the numberof years "a prospective © 


' (Medical.School Admissions*Requiremefits, 1955-56, 1965 -66 1975-76). 
. Two factors have strongly discouraged medical schools mt accepting 


‘Student can be expected to apply the. knowledge and. training acquired": | 


(Dubés: 197@a, p. 3). . ’ 


While the preponderance of accepted applicants oe 20-25: | 
years old, the relatively small number of app}icants betweehi the. agés » 


ve of. 17-20 have the -highest. ‘acceptance rates (Figyre'6.1).° Minority and * ° 


women applicants and, ehroliges tend to be solfewhat:older as’ & ‘group 
than their white male counterparts. Table 6.8*presents data-on the age, 


race and sex of applicants to the 1972. entering class. 
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Nonmatriculating and. Unaccepted Students 
a - 4 $ ne voy 7 - 5° eae 
The information available on noamatricukating students ist limited 
to an occasional reference to their numbers-jn the AAMC annual applicant 


Studies. Md apt Vey of nonmatriculating students remained. at . 


approximately 5 perdent until the 1970's, when it gradually dropped to 
an annual rate of about 3% (Johnsgn and Dubé, 1975). . j 


"All of the information discovered in the literature on he changas 


in characteristics of unaccepted applicants has-been cited it’ previous. 
sections of this chapter. ‘However, as Green (1970) points out, little 


research ‘kas been conducted in. this area over the years. Most studies .~ 


focus on the successful’ yather than the unsuccessful applicant. 


et 455 


Source: Johnson, D.G., Smith, ¥.C., Jr. and Tarnoff, S.L. Recruitment and: Progress of 
Minority Medical School Entrants, 1970-1972. Journal of Medical Education. 
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MEAs AcE ay Race. SEV. AND MATRICULATION SUCCESS UF APPLICANTS TO THE 


19725EN TERING Mepicag Scuiour Crass 


aoe 


oad 


Bach Amencsa Mearcan 
Matreutation Caucaseens Amencans Indians Amencans 

ok Status (23. 096)9¢ LHOy feral) (229) 
“Male 25 32 14.6 244 
*“*Noamastnculants 240 138 24.5 249 
Matrculonts 228 244 - 2380 240 
Fensle , 237 240 248 14) 
Nonmuatricutants no ‘4? 146 14] 259 
Matricutunts ‘ qt 134 249 224 
All applicants 136 m9! 147 144 
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tt gates inparenthers are the tutal number of individuals about whom all of the above data 


were-uvailable at the (ume study was conducted 
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$0:713-755, July, 1975. 


Oude, W. F., Johnson, 0. G.. and Nelson, B. C. Study of U.S. Medica) Schoo} 
48:395-820, May, 1973. 
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o-" t.. .Some Viterature does exist on ‘the: Re oe cece ep Gants 
_ These studies explore such areas as the.percent: ge of rejected appli- 
" cants. who reapply; how many ines they geepplys -how successful they are’ 
" y, Upon reapplication; what types oficareérs they choose as an alternative 


“to medicine; and what type of counséling could be given to them . 
(Hutchins and Morris, 1963; Green,—1970; Hamberg:and Schwarz, 19723 -. 
Becker et &l., 1973; Levine et al., 1974; AAMC, 1976c). What these . 
studies of rejected applicants show is that, in spite of having the 
door to a medical careér-g¢losed to them, a large proportion of them . 
have been sufficiently interested in a career in health to again attempt 


to open, that door by reapplying to.a U.S. school or by studying medicine . 


_Sbmead. Or they may attempt to open other doors by applying for study 
n 


aintegrated system of health care which can effectively utilize workers 
at aT levels of professional trainingyand in all health fields. ane 
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Yn other health professions. Certainly such persons are .an asset for an 
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Who becomes a pvsigtan ain (how wet” that: 


person. practices i nedicine, by.’ "kO: means depends” alely. - 


on. modi ficatio ‘admissions-pracédures and im- ~ 
- proved personality. assessment. «For iffonly admis~ , 


sion procedures ang ‘standards are’ modified without , 


, concomitant changes in ‘itedicat “education and, the 


health care systehi inswhich students are eventual ly 


called upon to practice ,. one -can count .on, little of 
positive “consequence. resulting from even major modi . 


fications of the se lection system: What i8 needed.. 


is an articulated strategy’ affecting the sélection le 
of future physicians, “the desig and maintenance of ¥. 


those instructional situations in 
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